SecurityITest.TestEncryptionWithKMSIntegration: Unrecognized error type. Please see the error log for more information.

[==========] Running 57 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 31 tests from SecurityITest
[ RUN      ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:02:06 dist-test-slave-4k3m krb5kdc[5769](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:02:06 dist-test-slave-4k3m krb5kdc[5769](info): set up 2 sockets
Dec 11 15:02:06 dist-test-slave-4k3m krb5kdc[5769](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20251211 15:02:08.636018  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.830s	user 0.003s	sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:02:08 dist-test-slave-4k3m krb5kdc[5769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465328, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:02:08Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:02:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:08.781586  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:37467
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:37467
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:08.892180  5785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:08.892474  5785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:08.892570  5785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:08.896088  5785 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:02:08.896184  5785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:08.896221  5785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:08.896252  5785 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:02:08.896289  5785 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:02:08.901036  5785 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:37467
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:37467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:08.902241  5785 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:08.903203  5785 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:08.909933  5793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:08.910153  5785 server_base.cc:1047] running on GCE node
W20251211 15:02:08.909940  5791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:08.909933  5790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:08.910833  5785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:08.911931  5785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:08.913097  5785 hybrid_clock.cc:648] HybridClock initialized: now 1765465328913087 us; error 32 us; skew 500 ppm
Dec 11 15:02:08 dist-test-slave-4k3m krb5kdc[5769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465328, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:08.915746  5785 init.cc:377] Logged in from keytab as kudu/127.5.160.190@KRBTEST.COM (short username kudu)
I20251211 15:02:08.916908  5785 webserver.cc:492] Webserver started at http://127.5.160.190:35563/ using document root <none> and password file <none>
I20251211 15:02:08.917465  5785 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:08.917514  5785 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:08.917708  5785 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:08.919540  5785 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "1d4a0d01148c4b3c954c4308cb531d87"
format_stamp: "Formatted at 2025-12-11 15:02:08 on dist-test-slave-4k3m"
server_key: "4ed5a011a13d5cd0c2f86741742cf16c"
server_key_iv: "4e6114a95903171a6d44545f6fbcca87"
server_key_version: "encryptionkey@0"
I20251211 15:02:08.920045  5785 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "1d4a0d01148c4b3c954c4308cb531d87"
format_stamp: "Formatted at 2025-12-11 15:02:08 on dist-test-slave-4k3m"
server_key: "4ed5a011a13d5cd0c2f86741742cf16c"
server_key_iv: "4e6114a95903171a6d44545f6fbcca87"
server_key_version: "encryptionkey@0"
I20251211 15:02:08.923638  5785 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20251211 15:02:08.926047  5800 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:08.927239  5785 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:02:08.927359  5785 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "1d4a0d01148c4b3c954c4308cb531d87"
format_stamp: "Formatted at 2025-12-11 15:02:08 on dist-test-slave-4k3m"
server_key: "4ed5a011a13d5cd0c2f86741742cf16c"
server_key_iv: "4e6114a95903171a6d44545f6fbcca87"
server_key_version: "encryptionkey@0"
I20251211 15:02:08.927469  5785 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:08.938897  5785 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:08.942096  5785 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:08.942292  5785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:08.950731  5785 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:37467
I20251211 15:02:08.950736  5852 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:37467 every 8 connection(s)
I20251211 15:02:08.951840  5785 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:02:08.954742  5853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:08.958189  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 5785
I20251211 15:02:08.958343  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:02:08.959645  5762 external_mini_cluster.cc:1468] Setting key 64ff8a3b8b1776fae8d24d6b5e06db46
I20251211 15:02:08.961457  5853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87: Bootstrap starting.
I20251211 15:02:08.964138  5853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:08.965057  5853 log.cc:826] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:08.967247  5853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87: No bootstrap required, opened a new log
I20251211 15:02:08.970504  5853 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4a0d01148c4b3c954c4308cb531d87" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37467 } }
I20251211 15:02:08.970803  5853 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:08.970858  5853 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d4a0d01148c4b3c954c4308cb531d87, State: Initialized, Role: FOLLOWER
I20251211 15:02:08.971439  5853 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4a0d01148c4b3c954c4308cb531d87" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37467 } }
I20251211 15:02:08.971621  5853 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:02:08.971755  5853 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:02:08.971868  5853 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:08.973191  5853 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4a0d01148c4b3c954c4308cb531d87" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37467 } }
I20251211 15:02:08.973701  5853 leader_election.cc:304] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d4a0d01148c4b3c954c4308cb531d87; no voters: 
I20251211 15:02:08.974074  5853 leader_election.cc:290] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:02:08.974246  5858 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:08.974484  5858 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [term 1 LEADER]: Becoming Leader. State: Replica: 1d4a0d01148c4b3c954c4308cb531d87, State: Running, Role: LEADER
Dec 11 15:02:08 dist-test-slave-4k3m krb5kdc[5769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465328, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:08.974903  5858 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4a0d01148c4b3c954c4308cb531d87" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37467 } }
I20251211 15:02:08.975415  5853 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:02:08.977444  5860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d4a0d01148c4b3c954c4308cb531d87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4a0d01148c4b3c954c4308cb531d87" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37467 } } }
I20251211 15:02:08.977588  5860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:08.978005  5859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d4a0d01148c4b3c954c4308cb531d87. Latest consensus state: current_term: 1 leader_uuid: "1d4a0d01148c4b3c954c4308cb531d87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d4a0d01148c4b3c954c4308cb531d87" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37467 } } }
I20251211 15:02:08.978093  5859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:08.978442  5867 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:02:08.981658  5867 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:02:08.982295  5856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:08.962401 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50148 (local address 127.5.160.190:37467)
1211 15:02:08.962960 (+   559us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:08.962973 (+    13us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:08.963412 (+   439us) server_negotiation.cc:408] Connection header received
1211 15:02:08.966401 (+  2989us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:08.966419 (+    18us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:08.966716 (+   297us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:08.967056 (+   340us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:08.969472 (+  2416us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:08.970278 (+   806us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:08.971269 (+   991us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:08.971506 (+   237us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:08.975958 (+  4452us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:08.975985 (+    27us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:08.976000 (+    15us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:08.976061 (+    61us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:08.978387 (+  2326us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:08.979178 (+   791us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:08.979183 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:08.979189 (+     6us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:08.979270 (+    81us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:08.979594 (+   324us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:08.979597 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:08.979599 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:08.980058 (+   459us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:08.980281 (+   223us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:08.980954 (+   673us) server_negotiation.cc:300] Negotiation successful
1211 15:02:08.981248 (+   294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":130,"threads_started":1}
I20251211 15:02:08.987531  5867 catalog_manager.cc:1357] Generated new cluster ID: a581fcc9478f4ed3a5439ae2e4eb1529
I20251211 15:02:08.987609  5867 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:02:09.000667  5867 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:02:09.001638  5867 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:02:09.015259  5867 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 1d4a0d01148c4b3c954c4308cb531d87: Generated new TSK 0
I20251211 15:02:09.016258  5867 catalog_manager.cc:1524] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:09.068082  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:37467
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:09.180878  5881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:09.181130  5881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:09.181192  5881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:09.184753  5881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:09.184842  5881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:09.184934  5881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:02:09.189531  5881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:37467
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:09.190743  5881 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:09.191707  5881 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:09.200043  5889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:09.200044  5887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:09.200043  5886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:09.200620  5881 server_base.cc:1047] running on GCE node
I20251211 15:02:09.201169  5881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:09.201903  5881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:09.203035  5881 hybrid_clock.cc:648] HybridClock initialized: now 1765465329203005 us; error 46 us; skew 500 ppm
Dec 11 15:02:09 dist-test-slave-4k3m krb5kdc[5769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465329, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:09.206053  5881 init.cc:377] Logged in from keytab as kudu/127.5.160.129@KRBTEST.COM (short username kudu)
I20251211 15:02:09.207312  5881 webserver.cc:492] Webserver started at http://127.5.160.129:40961/ using document root <none> and password file <none>
I20251211 15:02:09.207901  5881 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:09.207954  5881 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:09.208140  5881 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:09.209941  5881 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "638664a68a6643eab5a088c7522b03a4"
format_stamp: "Formatted at 2025-12-11 15:02:09 on dist-test-slave-4k3m"
server_key: "f50b2d477f6e236d6c674688f4315763"
server_key_iv: "a08ad064f239729c0322d4318a0079e9"
server_key_version: "encryptionkey@0"
I20251211 15:02:09.210455  5881 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "638664a68a6643eab5a088c7522b03a4"
format_stamp: "Formatted at 2025-12-11 15:02:09 on dist-test-slave-4k3m"
server_key: "f50b2d477f6e236d6c674688f4315763"
server_key_iv: "a08ad064f239729c0322d4318a0079e9"
server_key_version: "encryptionkey@0"
I20251211 15:02:09.214073  5881 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.004s
I20251211 15:02:09.216629  5896 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:09.217811  5881 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:02:09.217940  5881 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "638664a68a6643eab5a088c7522b03a4"
format_stamp: "Formatted at 2025-12-11 15:02:09 on dist-test-slave-4k3m"
server_key: "f50b2d477f6e236d6c674688f4315763"
server_key_iv: "a08ad064f239729c0322d4318a0079e9"
server_key_version: "encryptionkey@0"
I20251211 15:02:09.218051  5881 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:09.235715  5881 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:09.238914  5881 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:09.239130  5881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:09.239733  5881 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:09.240744  5881 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:09.240799  5881 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:09.240854  5881 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:09.240883  5881 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:09.250636  5881 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:37871
I20251211 15:02:09.250670  6009 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:37871 every 8 connection(s)
I20251211 15:02:09.251673  5881 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:02:09.254343  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 5881
I20251211 15:02:09.254446  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:02:09.254693  5762 external_mini_cluster.cc:1468] Setting key df21076d55440947464d6ca2de1b7d49
Dec 11 15:02:09 dist-test-slave-4k3m krb5kdc[5769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465329, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.130@KRBTEST.COM" created.
I20251211 15:02:09.265571  5856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:09.253522 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:58523 (local address 127.5.160.190:37467)
1211 15:02:09.253665 (+   143us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:09.253669 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:09.254384 (+   715us) server_negotiation.cc:408] Connection header received
1211 15:02:09.255366 (+   982us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:09.255370 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:09.255429 (+    59us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:09.255504 (+    75us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:09.257233 (+  1729us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.258028 (+   795us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:09.258684 (+   656us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.258870 (+   186us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:09.261342 (+  2472us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:09.261371 (+    29us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:09.261373 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:09.261404 (+    31us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:09.263272 (+  1868us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:09.263966 (+   694us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:09.263971 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:09.263972 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:09.264027 (+    55us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:09.264332 (+   305us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:09.264335 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:09.264337 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:09.264508 (+   171us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:09.264638 (+   130us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:09.265236 (+   598us) server_negotiation.cc:300] Negotiation successful
1211 15:02:09.265389 (+   153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20251211 15:02:09.266278  6012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:09.253794 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:37467 (local address 127.5.160.129:58523)
1211 15:02:09.254231 (+   437us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:09.254273 (+    42us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:09.255164 (+   891us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:09.255687 (+   523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:09.255696 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:09.256120 (+   424us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:09.257067 (+   947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:09.257082 (+    15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.258156 (+  1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:09.258159 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:09.258573 (+   414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:09.258581 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.258832 (+   251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:09.259637 (+   805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:09.259665 (+    28us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:09.261170 (+  1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:09.263425 (+  2255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:09.263438 (+    13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:09.263458 (+    20us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:09.263858 (+   400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:09.264113 (+   255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:09.264116 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:09.264118 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:09.264242 (+   124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:09.264628 (+   386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:09.264637 (+     9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:09.264939 (+   302us) client_negotiation.cc:769] Sending connection context
1211 15:02:09.265148 (+   209us) client_negotiation.cc:240] Negotiation successful
1211 15:02:09.265457 (+   309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":108,"threads_started":1}
I20251211 15:02:09.267580  6010 heartbeater.cc:344] Connected to a master server at 127.5.160.190:37467
I20251211 15:02:09.267895  6010 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:09.268579  6010 heartbeater.cc:507] Master 127.5.160.190:37467 requested a full tablet report, sending...
I20251211 15:02:09.270413  5817 ts_manager.cc:194] Registered new tserver with Master: 638664a68a6643eab5a088c7522b03a4 (127.5.160.129:37871)
I20251211 15:02:09.271713  5817 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:58523
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:09.306763  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:37467
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:09.419312  6017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:09.419579  6017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:09.419665  6017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:09.423385  6017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:09.423470  6017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:09.423576  6017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:02:09.428464  6017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:37467
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:09.429833  6017 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:09.430794  6017 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 15:02:09.439505  6017 server_base.cc:1047] running on GCE node
W20251211 15:02:09.439301  6022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:09.439323  6023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:09.439338  6025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:09.440193  6017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:09.440785  6017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:09.441958  6017 hybrid_clock.cc:648] HybridClock initialized: now 1765465329441942 us; error 34 us; skew 500 ppm
Dec 11 15:02:09 dist-test-slave-4k3m krb5kdc[5769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465329, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:09.444974  6017 init.cc:377] Logged in from keytab as kudu/127.5.160.130@KRBTEST.COM (short username kudu)
I20251211 15:02:09.446228  6017 webserver.cc:492] Webserver started at http://127.5.160.130:45889/ using document root <none> and password file <none>
I20251211 15:02:09.446792  6017 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:09.446846  6017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:09.447077  6017 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:09.448853  6017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "86a750625d8144648989a461e266e597"
format_stamp: "Formatted at 2025-12-11 15:02:09 on dist-test-slave-4k3m"
server_key: "fe4cec23d9cf938049bc95a7295ea261"
server_key_iv: "3a9dfd6d60e3aada8a674077b99d7837"
server_key_version: "encryptionkey@0"
I20251211 15:02:09.449314  6017 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "86a750625d8144648989a461e266e597"
format_stamp: "Formatted at 2025-12-11 15:02:09 on dist-test-slave-4k3m"
server_key: "fe4cec23d9cf938049bc95a7295ea261"
server_key_iv: "3a9dfd6d60e3aada8a674077b99d7837"
server_key_version: "encryptionkey@0"
I20251211 15:02:09.452906  6017 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20251211 15:02:09.455232  6032 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:09.456331  6017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20251211 15:02:09.456449  6017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "86a750625d8144648989a461e266e597"
format_stamp: "Formatted at 2025-12-11 15:02:09 on dist-test-slave-4k3m"
server_key: "fe4cec23d9cf938049bc95a7295ea261"
server_key_iv: "3a9dfd6d60e3aada8a674077b99d7837"
server_key_version: "encryptionkey@0"
I20251211 15:02:09.456544  6017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:09.512895  6017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:09.516043  6017 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:09.516224  6017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:09.516785  6017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:09.517735  6017 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:09.517783  6017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:09.517833  6017 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:09.517858  6017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:09.526764  6017 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:43367
I20251211 15:02:09.526798  6145 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:43367 every 8 connection(s)
I20251211 15:02:09.527794  6017 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:02:09.533612  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 6017
I20251211 15:02:09.533705  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:02:09.533924  5762 external_mini_cluster.cc:1468] Setting key d466c609f3e5b9aa6396bf8d0374884b
Dec 11 15:02:09 dist-test-slave-4k3m krb5kdc[5769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465329, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:09.541319  5856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:09.529596 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:55535 (local address 127.5.160.190:37467)
1211 15:02:09.529725 (+   129us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:09.529728 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:09.530464 (+   736us) server_negotiation.cc:408] Connection header received
1211 15:02:09.531449 (+   985us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:09.531456 (+     7us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:09.531519 (+    63us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:09.531590 (+    71us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:09.533387 (+  1797us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.533990 (+   603us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:09.534665 (+   675us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.534854 (+   189us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:09.537315 (+  2461us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:09.537332 (+    17us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:09.537335 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:09.537364 (+    29us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:09.539036 (+  1672us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:09.539687 (+   651us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:09.539690 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:09.539691 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:09.539742 (+    51us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:09.540123 (+   381us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:09.540126 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:09.540127 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:09.540296 (+   169us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:09.540372 (+    76us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:09.541070 (+   698us) server_negotiation.cc:300] Negotiation successful
1211 15:02:09.541190 (+   120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20251211 15:02:09.542279  6148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:09.529886 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:37467 (local address 127.5.160.130:55535)
1211 15:02:09.530314 (+   428us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:09.530351 (+    37us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:09.531236 (+   885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:09.531796 (+   560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:09.531805 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:09.532273 (+   468us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:09.533231 (+   958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:09.533246 (+    15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.534105 (+   859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:09.534108 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:09.534555 (+   447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:09.534565 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.534805 (+   240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:09.535489 (+   684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:09.535517 (+    28us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:09.537148 (+  1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:09.539166 (+  2018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:09.539174 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:09.539189 (+    15us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:09.539551 (+   362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:09.539852 (+   301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:09.539856 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:09.539858 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:09.540016 (+   158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:09.540399 (+   383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:09.540407 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:09.540753 (+   346us) client_negotiation.cc:769] Sending connection context
1211 15:02:09.541023 (+   270us) client_negotiation.cc:240] Negotiation successful
1211 15:02:09.541345 (+   322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":111,"threads_started":1}
WARNING: no policy specified for kudu/127.5.160.131@KRBTEST.COM; defaulting to no policy
I20251211 15:02:09.543687  6146 heartbeater.cc:344] Connected to a master server at 127.5.160.190:37467
I20251211 15:02:09.543957  6146 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:09.544540  6146 heartbeater.cc:507] Master 127.5.160.190:37467 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.131@KRBTEST.COM" created.
I20251211 15:02:09.545682  5817 ts_manager.cc:194] Registered new tserver with Master: 86a750625d8144648989a461e266e597 (127.5.160.130:43367)
I20251211 15:02:09.546278  5817 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.130@KRBTEST.COM'} at 127.5.160.130:55535
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:09.580220  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:37467
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:09.690918  6153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:09.691193  6153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:09.691256  6153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:09.694729  6153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:09.694811  6153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:09.694921  6153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:02:09.699476  6153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:37467
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:09.700686  6153 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:09.701601  6153 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:09.708918  6158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:09.708918  6161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:09.709012  6153 server_base.cc:1047] running on GCE node
W20251211 15:02:09.708918  6159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:09.709583  6153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:09.710204  6153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:09.711360  6153 hybrid_clock.cc:648] HybridClock initialized: now 1765465329711341 us; error 54 us; skew 500 ppm
Dec 11 15:02:09 dist-test-slave-4k3m krb5kdc[5769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465329, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:09.714068  6153 init.cc:377] Logged in from keytab as kudu/127.5.160.131@KRBTEST.COM (short username kudu)
I20251211 15:02:09.715247  6153 webserver.cc:492] Webserver started at http://127.5.160.131:34499/ using document root <none> and password file <none>
I20251211 15:02:09.715790  6153 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:09.715838  6153 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:09.716085  6153 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:09.717898  6153 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "6cdce582761d46afba0da846ca536ffc"
format_stamp: "Formatted at 2025-12-11 15:02:09 on dist-test-slave-4k3m"
server_key: "7ccb19efcfde86ea4bd22622b9fc037b"
server_key_iv: "c0fa79e88b6f4fe65a09680a0cd3b1c9"
server_key_version: "encryptionkey@0"
I20251211 15:02:09.718385  6153 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "6cdce582761d46afba0da846ca536ffc"
format_stamp: "Formatted at 2025-12-11 15:02:09 on dist-test-slave-4k3m"
server_key: "7ccb19efcfde86ea4bd22622b9fc037b"
server_key_iv: "c0fa79e88b6f4fe65a09680a0cd3b1c9"
server_key_version: "encryptionkey@0"
I20251211 15:02:09.721925  6153 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.004s
I20251211 15:02:09.724376  6168 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:09.725479  6153 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:02:09.725587  6153 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "6cdce582761d46afba0da846ca536ffc"
format_stamp: "Formatted at 2025-12-11 15:02:09 on dist-test-slave-4k3m"
server_key: "7ccb19efcfde86ea4bd22622b9fc037b"
server_key_iv: "c0fa79e88b6f4fe65a09680a0cd3b1c9"
server_key_version: "encryptionkey@0"
I20251211 15:02:09.725697  6153 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:09.742035  6153 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:09.744932  6153 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:09.745112  6153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:09.745677  6153 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:09.746563  6153 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:09.746609  6153 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:09.746651  6153 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:09.746680  6153 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:09.755934  6153 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:37487
I20251211 15:02:09.755962  6281 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:37487 every 8 connection(s)
I20251211 15:02:09.756937  6153 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
Dec 11 15:02:09 dist-test-slave-4k3m krb5kdc[5769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465329, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:09.765954  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 6153
I20251211 15:02:09.766067  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:02:09.766309  5762 external_mini_cluster.cc:1468] Setting key 56e133c5e5f4acc061f80c0893d62951
I20251211 15:02:09.770197  5856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:09.758895 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:46459 (local address 127.5.160.190:37467)
1211 15:02:09.759062 (+   167us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:09.759066 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:09.759838 (+   772us) server_negotiation.cc:408] Connection header received
1211 15:02:09.760723 (+   885us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:09.760727 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:09.760815 (+    88us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:09.760894 (+    79us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:09.762692 (+  1798us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.763248 (+   556us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:09.763918 (+   670us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.764096 (+   178us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:09.766538 (+  2442us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:09.766562 (+    24us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:09.766565 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:09.766596 (+    31us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:09.768181 (+  1585us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:09.768763 (+   582us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:09.768766 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:09.768768 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:09.768816 (+    48us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:09.769089 (+   273us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:09.769092 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:09.769094 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:09.769258 (+   164us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:09.769347 (+    89us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:09.769898 (+   551us) server_negotiation.cc:300] Negotiation successful
1211 15:02:09.770031 (+   133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20251211 15:02:09.770859  6284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:09.759182 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:37467 (local address 127.5.160.131:46459)
1211 15:02:09.759674 (+   492us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:09.759714 (+    40us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:09.760512 (+   798us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:09.761082 (+   570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:09.761091 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:09.761557 (+   466us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:09.762518 (+   961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:09.762534 (+    16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.763373 (+   839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:09.763376 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:09.763788 (+   412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:09.763796 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.764040 (+   244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:09.764672 (+   632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:09.764700 (+    28us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:09.766355 (+  1655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:09.768308 (+  1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:09.768314 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:09.768332 (+    18us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:09.768662 (+   330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:09.768897 (+   235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:09.768901 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:09.768903 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:09.769005 (+   102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:09.769358 (+   353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:09.769366 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:09.769625 (+   259us) client_negotiation.cc:769] Sending connection context
1211 15:02:09.769830 (+   205us) client_negotiation.cc:240] Negotiation successful
1211 15:02:09.770127 (+   297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":111,"threads_started":1}
I20251211 15:02:09.772034  6282 heartbeater.cc:344] Connected to a master server at 127.5.160.190:37467
I20251211 15:02:09.772321  6282 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:09.772887  6282 heartbeater.cc:507] Master 127.5.160.190:37467 requested a full tablet report, sending...
I20251211 15:02:09.773947  5817 ts_manager.cc:194] Registered new tserver with Master: 6cdce582761d46afba0da846ca536ffc (127.5.160.131:37487)
I20251211 15:02:09.774516  5817 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.131@KRBTEST.COM'} at 127.5.160.131:46459
I20251211 15:02:09.780670  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
Dec 11 15:02:09 dist-test-slave-4k3m krb5kdc[5769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465329, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM: 
Dec 11 15:02:09 dist-test-slave-4k3m krb5kdc[5769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465329, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.160.129@KRBTEST.COM
I20251211 15:02:09.806140  6289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:09.796635 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42484 (local address 127.5.160.129:37871)
1211 15:02:09.796947 (+   312us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:09.796956 (+     9us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:09.797049 (+    93us) server_negotiation.cc:408] Connection header received
1211 15:02:09.797203 (+   154us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:09.797209 (+     6us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:09.797414 (+   205us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:09.797564 (+   150us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:09.798563 (+   999us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.799331 (+   768us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:09.800020 (+   689us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.800276 (+   256us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:09.802480 (+  2204us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:09.802510 (+    30us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:09.802523 (+    13us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:09.802555 (+    32us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:09.804363 (+  1808us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:09.804868 (+   505us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:09.804874 (+     6us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:09.804876 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:09.804940 (+    64us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:09.805181 (+   241us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:09.805184 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:09.805186 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:09.805401 (+   215us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:09.805612 (+   211us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:09.805802 (+   190us) server_negotiation.cc:300] Negotiation successful
1211 15:02:09.805957 (+   155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":70,"threads_started":1}
W20251211 15:02:09.807138  5920 server_base.cc:1129] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42484
Dec 11 15:02:09 dist-test-slave-4k3m krb5kdc[5769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
Dec 11 15:02:09 dist-test-slave-4k3m krb5kdc[5769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.129@KRBTEST.COM
I20251211 15:02:09.831131  6289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:09.823717 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42488 (local address 127.5.160.129:37871)
1211 15:02:09.823889 (+   172us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:09.823893 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:09.823923 (+    30us) server_negotiation.cc:408] Connection header received
1211 15:02:09.824046 (+   123us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:09.824049 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:09.824100 (+    51us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:09.824167 (+    67us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:09.824900 (+   733us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.825390 (+   490us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:09.826016 (+   626us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:09.826179 (+   163us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:09.828265 (+  2086us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:09.828286 (+    21us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:09.828289 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:09.828318 (+    29us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:09.829691 (+  1373us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:09.830115 (+   424us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:09.830119 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:09.830121 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:09.830178 (+    57us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:09.830365 (+   187us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:09.830367 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:09.830377 (+    10us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:09.830548 (+   171us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:09.830652 (+   104us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:09.830822 (+   170us) server_negotiation.cc:300] Negotiation successful
1211 15:02:09.830962 (+   140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20251211 15:02:09.832227  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 5881
I20251211 15:02:09.837980  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 6017
I20251211 15:02:09.844774  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 6153
I20251211 15:02:09.851336  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 5785
2025-12-11T15:02:09Z chronyd exiting
[       OK ] SecurityITest.TestAuthorizationOnListTablets (3073 ms)
[ RUN      ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:02:09 dist-test-slave-4k3m krb5kdc[6296](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:02:09 dist-test-slave-4k3m krb5kdc[6296](info): set up 2 sockets
Dec 11 15:02:09 dist-test-slave-4k3m krb5kdc[6296](info): commencing operation
krb5kdc: starting...
W20251211 15:02:11.698977  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.826s	user 0.001s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:02:11 dist-test-slave-4k3m krb5kdc[6296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465331, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:02:11Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:02:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:11.834089  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40501
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:33451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:40501
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:11.941143  6312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:11.941401  6312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:11.941483  6312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:11.944878  6312 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:02:11.944945  6312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:11.944975  6312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:11.945000  6312 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:02:11.945032  6312 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:02:11.949502  6312 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:33451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:40501
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:11.950713  6312 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:11.951618  6312 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:11.957438  6320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:11.957687  6312 server_base.cc:1047] running on GCE node
W20251211 15:02:11.957581  6318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:11.957463  6317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:11.958304  6312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:11.959288  6312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:11.960459  6312 hybrid_clock.cc:648] HybridClock initialized: now 1765465331960424 us; error 46 us; skew 500 ppm
Dec 11 15:02:11 dist-test-slave-4k3m krb5kdc[6296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465331, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:11.963132  6312 init.cc:377] Logged in from keytab as kudu/127.5.160.190@KRBTEST.COM (short username kudu)
I20251211 15:02:11.964293  6312 webserver.cc:492] Webserver started at http://127.5.160.190:37321/ using document root <none> and password file <none>
I20251211 15:02:11.964895  6312 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:11.965018  6312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:11.965265  6312 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:11.967128  6312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "99e89c79bb8844709b22890f61b2da85"
format_stamp: "Formatted at 2025-12-11 15:02:11 on dist-test-slave-4k3m"
server_key: "b3ca4aed754f83ba4ba38751f2e278ab"
server_key_iv: "9bed78ac991f4fcc765048a6b84d5033"
server_key_version: "encryptionkey@0"
I20251211 15:02:11.967614  6312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "99e89c79bb8844709b22890f61b2da85"
format_stamp: "Formatted at 2025-12-11 15:02:11 on dist-test-slave-4k3m"
server_key: "b3ca4aed754f83ba4ba38751f2e278ab"
server_key_iv: "9bed78ac991f4fcc765048a6b84d5033"
server_key_version: "encryptionkey@0"
I20251211 15:02:11.971300  6312 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20251211 15:02:11.973676  6327 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:11.974792  6312 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:02:11.974911  6312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "99e89c79bb8844709b22890f61b2da85"
format_stamp: "Formatted at 2025-12-11 15:02:11 on dist-test-slave-4k3m"
server_key: "b3ca4aed754f83ba4ba38751f2e278ab"
server_key_iv: "9bed78ac991f4fcc765048a6b84d5033"
server_key_version: "encryptionkey@0"
I20251211 15:02:11.975060  6312 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:11.997169  6312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:12.004357  6312 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:12.004555  6312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:12.011837  6379 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:40501 every 8 connection(s)
I20251211 15:02:12.011845  6312 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:40501
I20251211 15:02:12.013115  6312 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:02:12.016042  6380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:12.020114  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 6312
I20251211 15:02:12.020220  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:02:12.020468  5762 external_mini_cluster.cc:1468] Setting key 99e060c75f65a9906189ad7bd8c85281
I20251211 15:02:12.021884  6380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85: Bootstrap starting.
I20251211 15:02:12.024499  6380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:12.025362  6380 log.cc:826] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:12.027362  6380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85: No bootstrap required, opened a new log
Dec 11 15:02:12 dist-test-slave-4k3m krb5kdc[6296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465331, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:12.030097  6380 raft_consensus.cc:359] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e89c79bb8844709b22890f61b2da85" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40501 } }
I20251211 15:02:12.030297  6380 raft_consensus.cc:385] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:12.030381  6380 raft_consensus.cc:740] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99e89c79bb8844709b22890f61b2da85, State: Initialized, Role: FOLLOWER
I20251211 15:02:12.030830  6380 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e89c79bb8844709b22890f61b2da85" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40501 } }
I20251211 15:02:12.030978  6380 raft_consensus.cc:399] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:02:12.031054  6380 raft_consensus.cc:493] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:02:12.031147  6380 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:12.031945  6380 raft_consensus.cc:515] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e89c79bb8844709b22890f61b2da85" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40501 } }
I20251211 15:02:12.032266  6380 leader_election.cc:304] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99e89c79bb8844709b22890f61b2da85; no voters: 
I20251211 15:02:12.032583  6380 leader_election.cc:290] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:02:12.032975  6385 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:12.033200  6385 raft_consensus.cc:697] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [term 1 LEADER]: Becoming Leader. State: Replica: 99e89c79bb8844709b22890f61b2da85, State: Running, Role: LEADER
I20251211 15:02:12.033572  6383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.021816 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49866 (local address 127.5.160.190:40501)
1211 15:02:12.022252 (+   436us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:12.022265 (+    13us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:12.022305 (+    40us) server_negotiation.cc:408] Connection header received
1211 15:02:12.023072 (+   767us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:12.023101 (+    29us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:12.023489 (+   388us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:12.023857 (+   368us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:12.024661 (+   804us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.025752 (+  1091us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.026433 (+   681us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.026710 (+   277us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.028880 (+  2170us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:12.028901 (+    21us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:12.028911 (+    10us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:12.028947 (+    36us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:12.030874 (+  1927us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.031389 (+   515us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.031394 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.031399 (+     5us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.031474 (+    75us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.031726 (+   252us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.031730 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.031732 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.032084 (+   352us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:12.032291 (+   207us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:12.032540 (+   249us) server_negotiation.cc:300] Negotiation successful
1211 15:02:12.032816 (+   276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":141,"threads_started":1}
I20251211 15:02:12.033545  6385 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e89c79bb8844709b22890f61b2da85" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40501 } }
I20251211 15:02:12.033897  6380 sys_catalog.cc:565] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:02:12.036082  6386 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99e89c79bb8844709b22890f61b2da85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e89c79bb8844709b22890f61b2da85" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40501 } } }
I20251211 15:02:12.036770  6386 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:12.036262  6387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99e89c79bb8844709b22890f61b2da85. Latest consensus state: current_term: 1 leader_uuid: "99e89c79bb8844709b22890f61b2da85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99e89c79bb8844709b22890f61b2da85" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40501 } } }
I20251211 15:02:12.036971  6387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85 [sys.catalog]: This master's current role is: LEADER
W20251211 15:02:12.038842  6399 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251211 15:02:12.038920  6399 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251211 15:02:12.039134  6400 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:02:12.039933  6400 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:02:12.045264  6400 catalog_manager.cc:1357] Generated new cluster ID: 37e8de122ae34bf48a4b6b37a439af2d
I20251211 15:02:12.045346  6400 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:02:12.057907  6400 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:02:12.059046  6400 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:02:12.065593  6400 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 99e89c79bb8844709b22890f61b2da85: Generated new TSK 0
I20251211 15:02:12.066491  6400 catalog_manager.cc:1524] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:12.119872  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40501
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:33451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:12.229825  6408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:12.230069  6408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:12.230152  6408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:12.233570  6408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:12.233645  6408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:12.233750  6408 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:02:12.238216  6408 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:33451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:40501
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:12.239383  6408 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:12.240283  6408 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:12.247373  6414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:12.247393  6413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:12.247404  6416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:12.247749  6408 server_base.cc:1047] running on GCE node
I20251211 15:02:12.248118  6408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:12.248664  6408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:12.249830  6408 hybrid_clock.cc:648] HybridClock initialized: now 1765465332249804 us; error 42 us; skew 500 ppm
Dec 11 15:02:12 dist-test-slave-4k3m krb5kdc[6296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465332, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:12.252564  6408 init.cc:377] Logged in from keytab as kudu/127.5.160.129@KRBTEST.COM (short username kudu)
I20251211 15:02:12.253652  6408 webserver.cc:492] Webserver started at http://127.5.160.129:44863/ using document root <none> and password file <none>
I20251211 15:02:12.254209  6408 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:12.254256  6408 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:12.254427  6408 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:12.256246  6408 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "a7d03e337e1d4fea89cabca45fbedc7d"
format_stamp: "Formatted at 2025-12-11 15:02:12 on dist-test-slave-4k3m"
server_key: "a13032045a33cfc0376205475dedcac1"
server_key_iv: "f05089400177542357a65cdd9111cde5"
server_key_version: "encryptionkey@0"
I20251211 15:02:12.256712  6408 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "a7d03e337e1d4fea89cabca45fbedc7d"
format_stamp: "Formatted at 2025-12-11 15:02:12 on dist-test-slave-4k3m"
server_key: "a13032045a33cfc0376205475dedcac1"
server_key_iv: "f05089400177542357a65cdd9111cde5"
server_key_version: "encryptionkey@0"
I20251211 15:02:12.260128  6408 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20251211 15:02:12.262348  6423 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:12.263485  6408 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:02:12.263579  6408 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "a7d03e337e1d4fea89cabca45fbedc7d"
format_stamp: "Formatted at 2025-12-11 15:02:12 on dist-test-slave-4k3m"
server_key: "a13032045a33cfc0376205475dedcac1"
server_key_iv: "f05089400177542357a65cdd9111cde5"
server_key_version: "encryptionkey@0"
I20251211 15:02:12.263674  6408 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:12.292754  6408 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:12.295655  6408 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:12.295814  6408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:12.296378  6408 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:12.297297  6408 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:12.297343  6408 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:12.297384  6408 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:12.297408  6408 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:12.306614  6408 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:44019
I20251211 15:02:12.306635  6536 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:44019 every 8 connection(s)
I20251211 15:02:12.307699  6408 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
Dec 11 15:02:12 dist-test-slave-4k3m krb5kdc[6296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465332, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:12.316285  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 6408
I20251211 15:02:12.316411  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:02:12.316663  5762 external_mini_cluster.cc:1468] Setting key 8b1a182e7019e5ea1d482f6d77c7e0eb
I20251211 15:02:12.319927  6383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.309539 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:50081 (local address 127.5.160.190:40501)
1211 15:02:12.309677 (+   138us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:12.309681 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:12.310298 (+   617us) server_negotiation.cc:408] Connection header received
1211 15:02:12.311234 (+   936us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:12.311238 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:12.311291 (+    53us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:12.311355 (+    64us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:12.312993 (+  1638us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.313486 (+   493us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.314101 (+   615us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.314228 (+   127us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.316468 (+  2240us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:12.316495 (+    27us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:12.316498 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:12.316530 (+    32us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:12.318002 (+  1472us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.318484 (+   482us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.318488 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.318490 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.318541 (+    51us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.318793 (+   252us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.318796 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.318798 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.319019 (+   221us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:12.319109 (+    90us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:12.319624 (+   515us) server_negotiation.cc:300] Negotiation successful
1211 15:02:12.319768 (+   144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20251211 15:02:12.320587  6539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.309719 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40501 (local address 127.5.160.129:50081)
1211 15:02:12.310153 (+   434us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:12.310189 (+    36us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:12.311030 (+   841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:12.311505 (+   475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:12.311513 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:12.311934 (+   421us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:12.312870 (+   936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.312885 (+    15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.313604 (+   719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.313606 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:12.314016 (+   410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.314023 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.314193 (+   170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.314750 (+   557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:12.314775 (+    25us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:12.316253 (+  1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:12.318120 (+  1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:12.318126 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:12.318136 (+    10us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:12.318384 (+   248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:12.318626 (+   242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:12.318628 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:12.318630 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:12.318724 (+    94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:12.319109 (+   385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:12.319116 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:12.319364 (+   248us) client_negotiation.cc:769] Sending connection context
1211 15:02:12.319566 (+   202us) client_negotiation.cc:240] Negotiation successful
1211 15:02:12.319865 (+   299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":117,"threads_started":1}
I20251211 15:02:12.321720  6537 heartbeater.cc:344] Connected to a master server at 127.5.160.190:40501
I20251211 15:02:12.321960  6537 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:12.322491  6537 heartbeater.cc:507] Master 127.5.160.190:40501 requested a full tablet report, sending...
I20251211 15:02:12.324023  6344 ts_manager.cc:194] Registered new tserver with Master: a7d03e337e1d4fea89cabca45fbedc7d (127.5.160.129:44019)
WARNING: no policy specified for kudu/127.5.160.130@KRBTEST.COM; defaulting to no policy
I20251211 15:02:12.325206  6344 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:50081
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:12.363018  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40501
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:33451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:12.470118  6544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:12.470361  6544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:12.470423  6544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:12.473739  6544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:12.473811  6544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:12.473893  6544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:02:12.478313  6544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:33451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:40501
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:12.479465  6544 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:12.480311  6544 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:12.486979  6549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:12.487082  6544 server_base.cc:1047] running on GCE node
W20251211 15:02:12.486990  6550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:12.486990  6552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:12.487571  6544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:12.488129  6544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:12.489280  6544 hybrid_clock.cc:648] HybridClock initialized: now 1765465332489260 us; error 34 us; skew 500 ppm
Dec 11 15:02:12 dist-test-slave-4k3m krb5kdc[6296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465332, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:12.492060  6544 init.cc:377] Logged in from keytab as kudu/127.5.160.130@KRBTEST.COM (short username kudu)
I20251211 15:02:12.493139  6544 webserver.cc:492] Webserver started at http://127.5.160.130:46385/ using document root <none> and password file <none>
I20251211 15:02:12.493676  6544 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:12.493726  6544 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:12.493911  6544 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:12.495716  6544 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "0b1d017536b14787b8a6293dbdc3c755"
format_stamp: "Formatted at 2025-12-11 15:02:12 on dist-test-slave-4k3m"
server_key: "8e66a4d81ded9bdc0b27c428c7ff768b"
server_key_iv: "c5dae8055cedb628236f80289fb2d78b"
server_key_version: "encryptionkey@0"
I20251211 15:02:12.496178  6544 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "0b1d017536b14787b8a6293dbdc3c755"
format_stamp: "Formatted at 2025-12-11 15:02:12 on dist-test-slave-4k3m"
server_key: "8e66a4d81ded9bdc0b27c428c7ff768b"
server_key_iv: "c5dae8055cedb628236f80289fb2d78b"
server_key_version: "encryptionkey@0"
I20251211 15:02:12.499620  6544 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20251211 15:02:12.501968  6559 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:12.503090  6544 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20251211 15:02:12.503197  6544 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "0b1d017536b14787b8a6293dbdc3c755"
format_stamp: "Formatted at 2025-12-11 15:02:12 on dist-test-slave-4k3m"
server_key: "8e66a4d81ded9bdc0b27c428c7ff768b"
server_key_iv: "c5dae8055cedb628236f80289fb2d78b"
server_key_version: "encryptionkey@0"
I20251211 15:02:12.503300  6544 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:12.515520  6544 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:12.518558  6544 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:12.518738  6544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:12.519359  6544 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:12.520228  6544 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:12.520274  6544 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:12.520314  6544 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:12.520342  6544 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:12.529147  6544 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:44335
I20251211 15:02:12.529187  6672 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:44335 every 8 connection(s)
I20251211 15:02:12.530105  6544 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
Dec 11 15:02:12 dist-test-slave-4k3m krb5kdc[6296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465332, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:12.538846  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 6544
I20251211 15:02:12.538951  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:02:12.539181  5762 external_mini_cluster.cc:1468] Setting key a44c8ef237c7b1f6210dee02edd55ca1
I20251211 15:02:12.543495  6383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.532011 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:52671 (local address 127.5.160.190:40501)
1211 15:02:12.532186 (+   175us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:12.532191 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:12.532904 (+   713us) server_negotiation.cc:408] Connection header received
1211 15:02:12.533826 (+   922us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:12.533830 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:12.533884 (+    54us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:12.533956 (+    72us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:12.535788 (+  1832us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.536333 (+   545us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.537023 (+   690us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.537206 (+   183us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.539660 (+  2454us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:12.539687 (+    27us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:12.539690 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:12.539726 (+    36us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:12.541196 (+  1470us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.541825 (+   629us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.541829 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.541830 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.541889 (+    59us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.542258 (+   369us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.542263 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.542265 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.542504 (+   239us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:12.542615 (+   111us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:12.543190 (+   575us) server_negotiation.cc:300] Negotiation successful
1211 15:02:12.543338 (+   148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20251211 15:02:12.544134  6675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.532313 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40501 (local address 127.5.160.130:52671)
1211 15:02:12.532764 (+   451us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:12.532801 (+    37us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:12.533623 (+   822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:12.534117 (+   494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:12.534125 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:12.534587 (+   462us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:12.535636 (+  1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.535652 (+    16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.536454 (+   802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.536458 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:12.536901 (+   443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.536910 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.537135 (+   225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.537760 (+   625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:12.537787 (+    27us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:12.539466 (+  1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:12.541341 (+  1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:12.541348 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:12.541361 (+    13us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:12.541714 (+   353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:12.541977 (+   263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:12.541979 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:12.541981 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:12.542123 (+   142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:12.542628 (+   505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:12.542634 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:12.542894 (+   260us) client_negotiation.cc:769] Sending connection context
1211 15:02:12.543129 (+   235us) client_negotiation.cc:240] Negotiation successful
1211 15:02:12.543370 (+   241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":116,"threads_started":1}
I20251211 15:02:12.545245  6673 heartbeater.cc:344] Connected to a master server at 127.5.160.190:40501
I20251211 15:02:12.545557  6673 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:12.546221  6673 heartbeater.cc:507] Master 127.5.160.190:40501 requested a full tablet report, sending...
I20251211 15:02:12.547336  6344 ts_manager.cc:194] Registered new tserver with Master: 0b1d017536b14787b8a6293dbdc3c755 (127.5.160.130:44335)
WARNING: no policy specified for kudu/127.5.160.131@KRBTEST.COM; defaulting to no policy
I20251211 15:02:12.547936  6344 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.130@KRBTEST.COM'} at 127.5.160.130:52671
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:12.584197  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40501
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:33451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:12.691653  6680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:12.691879  6680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:12.691938  6680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:12.695284  6680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:12.695355  6680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:12.695441  6680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:02:12.699752  6680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:33451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:40501
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:12.700820  6680 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:12.701627  6680 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:12.708357  6688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:12.708447  6685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:12.708446  6686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:12.708824  6680 server_base.cc:1047] running on GCE node
I20251211 15:02:12.709252  6680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:12.709833  6680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:12.710992  6680 hybrid_clock.cc:648] HybridClock initialized: now 1765465332710973 us; error 34 us; skew 500 ppm
Dec 11 15:02:12 dist-test-slave-4k3m krb5kdc[6296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465332, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:12.713588  6680 init.cc:377] Logged in from keytab as kudu/127.5.160.131@KRBTEST.COM (short username kudu)
I20251211 15:02:12.714610  6680 webserver.cc:492] Webserver started at http://127.5.160.131:32997/ using document root <none> and password file <none>
I20251211 15:02:12.715173  6680 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:12.715222  6680 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:12.715391  6680 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:12.717036  6680 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "be5c3ec416c14010a0c767129f15f8a4"
format_stamp: "Formatted at 2025-12-11 15:02:12 on dist-test-slave-4k3m"
server_key: "5a91bd60e048697271b5ff142e0ade90"
server_key_iv: "19f933175c68a9013446f599a1fe3ec5"
server_key_version: "encryptionkey@0"
I20251211 15:02:12.717478  6680 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "be5c3ec416c14010a0c767129f15f8a4"
format_stamp: "Formatted at 2025-12-11 15:02:12 on dist-test-slave-4k3m"
server_key: "5a91bd60e048697271b5ff142e0ade90"
server_key_iv: "19f933175c68a9013446f599a1fe3ec5"
server_key_version: "encryptionkey@0"
I20251211 15:02:12.720919  6680 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20251211 15:02:12.723088  6695 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:12.724148  6680 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:02:12.724269  6680 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "be5c3ec416c14010a0c767129f15f8a4"
format_stamp: "Formatted at 2025-12-11 15:02:12 on dist-test-slave-4k3m"
server_key: "5a91bd60e048697271b5ff142e0ade90"
server_key_iv: "19f933175c68a9013446f599a1fe3ec5"
server_key_version: "encryptionkey@0"
I20251211 15:02:12.724367  6680 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:12.748412  6680 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:12.751250  6680 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:12.751421  6680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:12.751981  6680 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:12.752873  6680 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:12.752923  6680 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:12.752974  6680 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:12.753001  6680 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:12.762023  6680 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:38293
I20251211 15:02:12.762039  6808 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:38293 every 8 connection(s)
I20251211 15:02:12.763095  6680 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
I20251211 15:02:12.769877  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 6680
I20251211 15:02:12.769989  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:02:12.770215  5762 external_mini_cluster.cc:1468] Setting key 70bb974aca6243585b9fd53e0420f4ba
Dec 11 15:02:12 dist-test-slave-4k3m krb5kdc[6296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465332, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:12.775444  6383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.764852 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:59887 (local address 127.5.160.190:40501)
1211 15:02:12.765020 (+   168us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:12.765024 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:12.765759 (+   735us) server_negotiation.cc:408] Connection header received
1211 15:02:12.766658 (+   899us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:12.766662 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:12.766722 (+    60us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:12.766799 (+    77us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:12.768600 (+  1801us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.769108 (+   508us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.769777 (+   669us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.769959 (+   182us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.772473 (+  2514us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:12.772492 (+    19us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:12.772496 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:12.772530 (+    34us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:12.773695 (+  1165us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.774139 (+   444us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.774141 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.774143 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.774183 (+    40us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.774390 (+   207us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.774392 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.774393 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.774551 (+   158us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:12.774629 (+    78us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:12.775190 (+   561us) server_negotiation.cc:300] Negotiation successful
1211 15:02:12.775324 (+   134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20251211 15:02:12.776093  6811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.765115 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40501 (local address 127.5.160.131:59887)
1211 15:02:12.765610 (+   495us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:12.765646 (+    36us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:12.766460 (+   814us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:12.767016 (+   556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:12.767025 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:12.767435 (+   410us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:12.768446 (+  1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.768463 (+    17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.769229 (+   766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.769233 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:12.769663 (+   430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.769670 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.769909 (+   239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.770616 (+   707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:12.770656 (+    40us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:12.772323 (+  1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:12.773804 (+  1481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:12.773809 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:12.773819 (+    10us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:12.774059 (+   240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:12.774240 (+   181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:12.774243 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:12.774244 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:12.774329 (+    85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:12.774629 (+   300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:12.774634 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:12.774907 (+   273us) client_negotiation.cc:769] Sending connection context
1211 15:02:12.775149 (+   242us) client_negotiation.cc:240] Negotiation successful
1211 15:02:12.775384 (+   235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":104,"threads_started":1}
I20251211 15:02:12.777227  6809 heartbeater.cc:344] Connected to a master server at 127.5.160.190:40501
I20251211 15:02:12.777499  6809 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:12.778095  6809 heartbeater.cc:507] Master 127.5.160.190:40501 requested a full tablet report, sending...
I20251211 15:02:12.779161  6344 ts_manager.cc:194] Registered new tserver with Master: be5c3ec416c14010a0c767129f15f8a4 (127.5.160.131:38293)
I20251211 15:02:12.779775  6344 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.131@KRBTEST.COM'} at 127.5.160.131:59887
I20251211 15:02:12.784179  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251211 15:02:12.793448  6383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.787029 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49874 (local address 127.5.160.190:40501)
1211 15:02:12.787167 (+   138us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:12.787172 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:12.787263 (+    91us) server_negotiation.cc:408] Connection header received
1211 15:02:12.787372 (+   109us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:12.787376 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:12.787433 (+    57us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:12.787498 (+    65us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:12.788294 (+   796us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.788790 (+   496us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.789438 (+   648us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.789668 (+   230us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.790623 (+   955us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:12.790643 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:12.790646 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:12.790672 (+    26us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:12.792061 (+  1389us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.792419 (+   358us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.792422 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.792424 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.792471 (+    47us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.792670 (+   199us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.792674 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.792676 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.792865 (+   189us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:12.792983 (+   118us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:12.793182 (+   199us) server_negotiation.cc:300] Negotiation successful
1211 15:02:12.793297 (+   115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20251211 15:02:12.797618  6344 catalog_manager.cc:2257] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49874:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20251211 15:02:12.800046  6344 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:02:12.813411  6820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.808701 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:44335 (local address 127.0.0.1:47114)
1211 15:02:12.809312 (+   611us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:12.809356 (+    44us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:12.809497 (+   141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:12.810588 (+  1091us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:12.810591 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:12.810610 (+    19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:12.810889 (+   279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.810897 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.812275 (+  1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.812280 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:12.813041 (+   761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.813050 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.813139 (+    89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.813158 (+    19us) client_negotiation.cc:769] Sending connection context
1211 15:02:12.813202 (+    44us) client_negotiation.cc:240] Negotiation successful
1211 15:02:12.813262 (+    60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":98,"threads_started":1}
I20251211 15:02:12.814082  6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.808941 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:44019 (local address 127.0.0.1:55402)
1211 15:02:12.809528 (+   587us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:12.809541 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:12.809629 (+    88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:12.810311 (+   682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:12.810317 (+     6us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:12.810356 (+    39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:12.810676 (+   320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.810685 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.812218 (+  1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.812222 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:12.813046 (+   824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.813053 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.813140 (+    87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.813153 (+    13us) client_negotiation.cc:769] Sending connection context
1211 15:02:12.813193 (+    40us) client_negotiation.cc:240] Negotiation successful
1211 15:02:12.813234 (+    41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":84,"threads_started":1}
I20251211 15:02:12.814253  6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.808809 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47114 (local address 127.5.160.130:44335)
1211 15:02:12.810131 (+  1322us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:12.810138 (+     7us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:12.810159 (+    21us) server_negotiation.cc:408] Connection header received
1211 15:02:12.810236 (+    77us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:12.810241 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:12.810427 (+   186us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:12.810587 (+   160us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:12.811016 (+   429us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.812132 (+  1116us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.813325 (+  1193us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.813852 (+   527us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.813974 (+   122us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:12.814039 (+    65us) server_negotiation.cc:300] Negotiation successful
1211 15:02:12.814132 (+    93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1221,"thread_start_us":146,"threads_started":1}
I20251211 15:02:12.814277  6825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.809683 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36638 (local address 127.5.160.131:38293)
1211 15:02:12.810270 (+   587us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:12.810277 (+     7us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:12.810297 (+    20us) server_negotiation.cc:408] Connection header received
1211 15:02:12.810396 (+    99us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:12.810401 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:12.810539 (+   138us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:12.811067 (+   528us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:12.811175 (+   108us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.811864 (+   689us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.813355 (+  1491us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.813891 (+   536us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.813996 (+   105us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:12.814059 (+    63us) server_negotiation.cc:300] Negotiation successful
1211 15:02:12.814138 (+    79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":111,"threads_started":1}
I20251211 15:02:12.814281  6824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.809508 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55402 (local address 127.5.160.129:44019)
1211 15:02:12.809820 (+   312us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:12.809828 (+     8us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:12.809853 (+    25us) server_negotiation.cc:408] Connection header received
1211 15:02:12.809938 (+    85us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:12.809943 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:12.810136 (+   193us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:12.810814 (+   678us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:12.810956 (+   142us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.812095 (+  1139us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.813351 (+  1256us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.813896 (+   545us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.813996 (+   100us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:12.814059 (+    63us) server_negotiation.cc:300] Negotiation successful
1211 15:02:12.814143 (+    84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":100,"threads_started":1}
I20251211 15:02:12.814539  6823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.809271 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:38293 (local address 127.0.0.1:36638)
1211 15:02:12.809953 (+   682us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:12.809965 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:12.810035 (+    70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:12.810684 (+   649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:12.810688 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:12.810702 (+    14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:12.810923 (+   221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.810952 (+    29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.811975 (+  1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.811979 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:12.812848 (+   869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.812858 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.812959 (+   101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.813021 (+    62us) client_negotiation.cc:769] Sending connection context
1211 15:02:12.813112 (+    91us) client_negotiation.cc:240] Negotiation successful
1211 15:02:12.813210 (+    98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":97,"threads_started":1}
I20251211 15:02:12.817214  6471 tablet_service.cc:1505] Processing CreateTablet for tablet af04eb18835e4307805d1ea0980cc32b (DEFAULT_TABLE table=test-table [id=e4b2213206a14213b72c6447372002af]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:12.817211  6607 tablet_service.cc:1505] Processing CreateTablet for tablet af04eb18835e4307805d1ea0980cc32b (DEFAULT_TABLE table=test-table [id=e4b2213206a14213b72c6447372002af]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:12.817211  6743 tablet_service.cc:1505] Processing CreateTablet for tablet af04eb18835e4307805d1ea0980cc32b (DEFAULT_TABLE table=test-table [id=e4b2213206a14213b72c6447372002af]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:12.818163  6471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af04eb18835e4307805d1ea0980cc32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:12.818164  6743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af04eb18835e4307805d1ea0980cc32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:12.818164  6607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af04eb18835e4307805d1ea0980cc32b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:12.823918  6826 tablet_bootstrap.cc:492] T af04eb18835e4307805d1ea0980cc32b P a7d03e337e1d4fea89cabca45fbedc7d: Bootstrap starting.
I20251211 15:02:12.825001  6828 tablet_bootstrap.cc:492] T af04eb18835e4307805d1ea0980cc32b P 0b1d017536b14787b8a6293dbdc3c755: Bootstrap starting.
I20251211 15:02:12.825410  6827 tablet_bootstrap.cc:492] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4: Bootstrap starting.
I20251211 15:02:12.826431  6826 tablet_bootstrap.cc:654] T af04eb18835e4307805d1ea0980cc32b P a7d03e337e1d4fea89cabca45fbedc7d: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:12.827211  6826 log.cc:826] T af04eb18835e4307805d1ea0980cc32b P a7d03e337e1d4fea89cabca45fbedc7d: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:12.827400  6828 tablet_bootstrap.cc:654] T af04eb18835e4307805d1ea0980cc32b P 0b1d017536b14787b8a6293dbdc3c755: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:12.828280  6828 log.cc:826] T af04eb18835e4307805d1ea0980cc32b P 0b1d017536b14787b8a6293dbdc3c755: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:12.828959  6827 tablet_bootstrap.cc:654] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:12.829149  6826 tablet_bootstrap.cc:492] T af04eb18835e4307805d1ea0980cc32b P a7d03e337e1d4fea89cabca45fbedc7d: No bootstrap required, opened a new log
I20251211 15:02:12.829351  6826 ts_tablet_manager.cc:1403] T af04eb18835e4307805d1ea0980cc32b P a7d03e337e1d4fea89cabca45fbedc7d: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20251211 15:02:12.829748  6827 log.cc:826] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:12.830296  6828 tablet_bootstrap.cc:492] T af04eb18835e4307805d1ea0980cc32b P 0b1d017536b14787b8a6293dbdc3c755: No bootstrap required, opened a new log
I20251211 15:02:12.830502  6828 ts_tablet_manager.cc:1403] T af04eb18835e4307805d1ea0980cc32b P 0b1d017536b14787b8a6293dbdc3c755: Time spent bootstrapping tablet: real 0.006s	user 0.003s	sys 0.000s
I20251211 15:02:12.831637  6827 tablet_bootstrap.cc:492] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4: No bootstrap required, opened a new log
I20251211 15:02:12.831841  6827 ts_tablet_manager.cc:1403] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4: Time spent bootstrapping tablet: real 0.007s	user 0.004s	sys 0.000s
I20251211 15:02:12.832515  6826 raft_consensus.cc:359] T af04eb18835e4307805d1ea0980cc32b P a7d03e337e1d4fea89cabca45fbedc7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b1d017536b14787b8a6293dbdc3c755" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 44335 } } peers { permanent_uuid: "a7d03e337e1d4fea89cabca45fbedc7d" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 44019 } } peers { permanent_uuid: "be5c3ec416c14010a0c767129f15f8a4" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38293 } }
I20251211 15:02:12.832753  6826 raft_consensus.cc:385] T af04eb18835e4307805d1ea0980cc32b P a7d03e337e1d4fea89cabca45fbedc7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:12.832845  6826 raft_consensus.cc:740] T af04eb18835e4307805d1ea0980cc32b P a7d03e337e1d4fea89cabca45fbedc7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7d03e337e1d4fea89cabca45fbedc7d, State: Initialized, Role: FOLLOWER
I20251211 15:02:12.833340  6826 consensus_queue.cc:260] T af04eb18835e4307805d1ea0980cc32b P a7d03e337e1d4fea89cabca45fbedc7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b1d017536b14787b8a6293dbdc3c755" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 44335 } } peers { permanent_uuid: "a7d03e337e1d4fea89cabca45fbedc7d" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 44019 } } peers { permanent_uuid: "be5c3ec416c14010a0c767129f15f8a4" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38293 } }
I20251211 15:02:12.833745  6828 raft_consensus.cc:359] T af04eb18835e4307805d1ea0980cc32b P 0b1d017536b14787b8a6293dbdc3c755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b1d017536b14787b8a6293dbdc3c755" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 44335 } } peers { permanent_uuid: "a7d03e337e1d4fea89cabca45fbedc7d" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 44019 } } peers { permanent_uuid: "be5c3ec416c14010a0c767129f15f8a4" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38293 } }
I20251211 15:02:12.834008  6828 raft_consensus.cc:385] T af04eb18835e4307805d1ea0980cc32b P 0b1d017536b14787b8a6293dbdc3c755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:12.834100  6828 raft_consensus.cc:740] T af04eb18835e4307805d1ea0980cc32b P 0b1d017536b14787b8a6293dbdc3c755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b1d017536b14787b8a6293dbdc3c755, State: Initialized, Role: FOLLOWER
I20251211 15:02:12.834138  6537 heartbeater.cc:499] Master 127.5.160.190:40501 was elected leader, sending a full tablet report...
I20251211 15:02:12.834348  6826 ts_tablet_manager.cc:1434] T af04eb18835e4307805d1ea0980cc32b P a7d03e337e1d4fea89cabca45fbedc7d: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20251211 15:02:12.834692  6828 consensus_queue.cc:260] T af04eb18835e4307805d1ea0980cc32b P 0b1d017536b14787b8a6293dbdc3c755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b1d017536b14787b8a6293dbdc3c755" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 44335 } } peers { permanent_uuid: "a7d03e337e1d4fea89cabca45fbedc7d" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 44019 } } peers { permanent_uuid: "be5c3ec416c14010a0c767129f15f8a4" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38293 } }
I20251211 15:02:12.835269  6827 raft_consensus.cc:359] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b1d017536b14787b8a6293dbdc3c755" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 44335 } } peers { permanent_uuid: "a7d03e337e1d4fea89cabca45fbedc7d" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 44019 } } peers { permanent_uuid: "be5c3ec416c14010a0c767129f15f8a4" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38293 } }
I20251211 15:02:12.835405  6673 heartbeater.cc:499] Master 127.5.160.190:40501 was elected leader, sending a full tablet report...
I20251211 15:02:12.835527  6827 raft_consensus.cc:385] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:12.835618  6827 raft_consensus.cc:740] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5c3ec416c14010a0c767129f15f8a4, State: Initialized, Role: FOLLOWER
I20251211 15:02:12.835690  6828 ts_tablet_manager.cc:1434] T af04eb18835e4307805d1ea0980cc32b P 0b1d017536b14787b8a6293dbdc3c755: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20251211 15:02:12.836081  6827 consensus_queue.cc:260] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b1d017536b14787b8a6293dbdc3c755" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 44335 } } peers { permanent_uuid: "a7d03e337e1d4fea89cabca45fbedc7d" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 44019 } } peers { permanent_uuid: "be5c3ec416c14010a0c767129f15f8a4" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38293 } }
I20251211 15:02:12.836831  6809 heartbeater.cc:499] Master 127.5.160.190:40501 was elected leader, sending a full tablet report...
I20251211 15:02:12.836949  6827 ts_tablet_manager.cc:1434] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20251211 15:02:12.906569  6834 raft_consensus.cc:493] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:02:12.906783  6834 raft_consensus.cc:515] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b1d017536b14787b8a6293dbdc3c755" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 44335 } } peers { permanent_uuid: "a7d03e337e1d4fea89cabca45fbedc7d" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 44019 } } peers { permanent_uuid: "be5c3ec416c14010a0c767129f15f8a4" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38293 } }
I20251211 15:02:12.907980  6834 leader_election.cc:290] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b1d017536b14787b8a6293dbdc3c755 (127.5.160.130:44335), a7d03e337e1d4fea89cabca45fbedc7d (127.5.160.129:44019)
I20251211 15:02:12.910957  6811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.908203 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:44019 (local address 127.5.160.131:37271)
1211 15:02:12.908320 (+   117us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:12.908334 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:12.908422 (+    88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:12.908678 (+   256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:12.908680 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:12.908698 (+    18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:12.908958 (+   260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.908967 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.909905 (+   938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.909909 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:12.910614 (+   705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.910623 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.910717 (+    94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.910743 (+    26us) client_negotiation.cc:769] Sending connection context
1211 15:02:12.910778 (+    35us) client_negotiation.cc:240] Negotiation successful
1211 15:02:12.910826 (+    48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20251211 15:02:12.911278  6835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.908203 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:44335 (local address 127.5.160.131:55837)
1211 15:02:12.908652 (+   449us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:12.908665 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:12.908753 (+    88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:12.908996 (+   243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:12.908999 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:12.909016 (+    17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:12.909318 (+   302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.909326 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.910171 (+   845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.910174 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:12.910864 (+   690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:12.910874 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.911021 (+   147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.911041 (+    20us) client_negotiation.cc:769] Sending connection context
1211 15:02:12.911089 (+    48us) client_negotiation.cc:240] Negotiation successful
1211 15:02:12.911144 (+    55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"mutex_wait_us":137,"thread_start_us":176,"threads_started":1}
I20251211 15:02:12.911496  6824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.908289 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:37271 (local address 127.5.160.129:44019)
1211 15:02:12.908414 (+   125us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:12.908418 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:12.908435 (+    17us) server_negotiation.cc:408] Connection header received
1211 15:02:12.908518 (+    83us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:12.908521 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:12.908570 (+    49us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:12.908657 (+    87us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:12.909084 (+   427us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.909780 (+   696us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.910755 (+   975us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.911238 (+   483us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.911278 (+    40us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:12.911329 (+    51us) server_negotiation.cc:300] Negotiation successful
1211 15:02:12.911396 (+    67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20251211 15:02:12.911753  6821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.908289 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:55837 (local address 127.5.160.130:44335)
1211 15:02:12.908414 (+   125us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:12.908418 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:12.908740 (+   322us) server_negotiation.cc:408] Connection header received
1211 15:02:12.908846 (+   106us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:12.908849 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:12.908898 (+    49us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:12.908971 (+    73us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:12.909455 (+   484us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.910037 (+   582us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.911005 (+   968us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.911500 (+   495us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.911534 (+    34us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:12.911586 (+    52us) server_negotiation.cc:300] Negotiation successful
1211 15:02:12.911648 (+    62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20251211 15:02:12.912261  6627 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af04eb18835e4307805d1ea0980cc32b" candidate_uuid: "be5c3ec416c14010a0c767129f15f8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b1d017536b14787b8a6293dbdc3c755" is_pre_election: true
I20251211 15:02:12.912279  6491 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af04eb18835e4307805d1ea0980cc32b" candidate_uuid: "be5c3ec416c14010a0c767129f15f8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7d03e337e1d4fea89cabca45fbedc7d" is_pre_election: true
I20251211 15:02:12.912516  6491 raft_consensus.cc:2468] T af04eb18835e4307805d1ea0980cc32b P a7d03e337e1d4fea89cabca45fbedc7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5c3ec416c14010a0c767129f15f8a4 in term 0.
I20251211 15:02:12.912518  6627 raft_consensus.cc:2468] T af04eb18835e4307805d1ea0980cc32b P 0b1d017536b14787b8a6293dbdc3c755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5c3ec416c14010a0c767129f15f8a4 in term 0.
I20251211 15:02:12.912977  6696 leader_election.cc:304] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0b1d017536b14787b8a6293dbdc3c755, a7d03e337e1d4fea89cabca45fbedc7d, be5c3ec416c14010a0c767129f15f8a4; no voters: 
I20251211 15:02:12.913230  6834 raft_consensus.cc:2804] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:02:12.913297  6834 raft_consensus.cc:493] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:02:12.913328  6834 raft_consensus.cc:3060] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:12.914230  6834 raft_consensus.cc:515] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b1d017536b14787b8a6293dbdc3c755" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 44335 } } peers { permanent_uuid: "a7d03e337e1d4fea89cabca45fbedc7d" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 44019 } } peers { permanent_uuid: "be5c3ec416c14010a0c767129f15f8a4" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38293 } }
I20251211 15:02:12.914582  6834 leader_election.cc:290] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [CANDIDATE]: Term 1 election: Requested vote from peers 0b1d017536b14787b8a6293dbdc3c755 (127.5.160.130:44335), a7d03e337e1d4fea89cabca45fbedc7d (127.5.160.129:44019)
I20251211 15:02:12.915042  6627 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af04eb18835e4307805d1ea0980cc32b" candidate_uuid: "be5c3ec416c14010a0c767129f15f8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b1d017536b14787b8a6293dbdc3c755"
I20251211 15:02:12.915079  6491 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af04eb18835e4307805d1ea0980cc32b" candidate_uuid: "be5c3ec416c14010a0c767129f15f8a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7d03e337e1d4fea89cabca45fbedc7d"
I20251211 15:02:12.915158  6627 raft_consensus.cc:3060] T af04eb18835e4307805d1ea0980cc32b P 0b1d017536b14787b8a6293dbdc3c755 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:12.915189  6491 raft_consensus.cc:3060] T af04eb18835e4307805d1ea0980cc32b P a7d03e337e1d4fea89cabca45fbedc7d [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:12.916092  6491 raft_consensus.cc:2468] T af04eb18835e4307805d1ea0980cc32b P a7d03e337e1d4fea89cabca45fbedc7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5c3ec416c14010a0c767129f15f8a4 in term 1.
I20251211 15:02:12.916159  6627 raft_consensus.cc:2468] T af04eb18835e4307805d1ea0980cc32b P 0b1d017536b14787b8a6293dbdc3c755 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5c3ec416c14010a0c767129f15f8a4 in term 1.
I20251211 15:02:12.916435  6696 leader_election.cc:304] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b1d017536b14787b8a6293dbdc3c755, be5c3ec416c14010a0c767129f15f8a4; no voters: 
I20251211 15:02:12.916647  6834 raft_consensus.cc:2804] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:12.916853  6834 raft_consensus.cc:697] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [term 1 LEADER]: Becoming Leader. State: Replica: be5c3ec416c14010a0c767129f15f8a4, State: Running, Role: LEADER
I20251211 15:02:12.917176  6834 consensus_queue.cc:237] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b1d017536b14787b8a6293dbdc3c755" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 44335 } } peers { permanent_uuid: "a7d03e337e1d4fea89cabca45fbedc7d" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 44019 } } peers { permanent_uuid: "be5c3ec416c14010a0c767129f15f8a4" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38293 } }
I20251211 15:02:12.920161  6343 catalog_manager.cc:5654] T af04eb18835e4307805d1ea0980cc32b P be5c3ec416c14010a0c767129f15f8a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to be5c3ec416c14010a0c767129f15f8a4 (127.5.160.131). New cstate: current_term: 1 leader_uuid: "be5c3ec416c14010a0c767129f15f8a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b1d017536b14787b8a6293dbdc3c755" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 44335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7d03e337e1d4fea89cabca45fbedc7d" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 44019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5c3ec416c14010a0c767129f15f8a4" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38293 } health_report { overall_health: HEALTHY } } }
Dec 11 15:02:12 dist-test-slave-4k3m krb5kdc[6296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465331, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.129@KRBTEST.COM
I20251211 15:02:12.940428  6824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.932015 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55418 (local address 127.5.160.129:44019)
1211 15:02:12.932194 (+   179us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:12.932198 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:12.932266 (+    68us) server_negotiation.cc:408] Connection header received
1211 15:02:12.932373 (+   107us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:12.932376 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:12.932435 (+    59us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:12.932510 (+    75us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:12.933295 (+   785us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.933801 (+   506us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.934404 (+   603us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.934578 (+   174us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.936821 (+  2243us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:12.936851 (+    30us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:12.936864 (+    13us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:12.936896 (+    32us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:12.938513 (+  1617us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.938979 (+   466us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.938986 (+     7us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.938987 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.939051 (+    64us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.939276 (+   225us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.939280 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.939282 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.939673 (+   391us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:12.939919 (+   246us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:12.940138 (+   219us) server_negotiation.cc:300] Negotiation successful
1211 15:02:12.940273 (+   135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
Dec 11 15:02:12 dist-test-slave-4k3m krb5kdc[6296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465332, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM: 
Dec 11 15:02:12 dist-test-slave-4k3m krb5kdc[6296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465332, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.160.129@KRBTEST.COM
I20251211 15:02:12.964259  6824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.957081 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55432 (local address 127.5.160.129:44019)
1211 15:02:12.957225 (+   144us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:12.957229 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:12.957245 (+    16us) server_negotiation.cc:408] Connection header received
1211 15:02:12.957362 (+   117us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:12.957365 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:12.957410 (+    45us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:12.957479 (+    69us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:12.958262 (+   783us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.958758 (+   496us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.959439 (+   681us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.959671 (+   232us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.961611 (+  1940us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:12.961633 (+    22us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:12.961635 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:12.961665 (+    30us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:12.963111 (+  1446us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.963424 (+   313us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.963426 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.963428 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.963466 (+    38us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.963602 (+   136us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.963604 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.963605 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.963731 (+   126us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:12.963837 (+   106us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:12.964013 (+   176us) server_negotiation.cc:300] Negotiation successful
1211 15:02:12.964104 (+    91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Dec 11 15:02:12 dist-test-slave-4k3m krb5kdc[6296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
Dec 11 15:02:12 dist-test-slave-4k3m krb5kdc[6296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.129@KRBTEST.COM
I20251211 15:02:12.987521  6824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:12.980155 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55436 (local address 127.5.160.129:44019)
1211 15:02:12.980306 (+   151us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:12.980311 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:12.980394 (+    83us) server_negotiation.cc:408] Connection header received
1211 15:02:12.980533 (+   139us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:12.980537 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:12.980601 (+    64us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:12.980671 (+    70us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:12.981453 (+   782us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.981922 (+   469us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:12.982542 (+   620us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:12.982731 (+   189us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:12.984846 (+  2115us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:12.984866 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:12.984868 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:12.984899 (+    31us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:12.986243 (+  1344us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.986621 (+   378us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.986623 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.986625 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.986662 (+    37us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:12.986824 (+   162us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:12.986827 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:12.986829 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:12.986993 (+   164us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:12.987089 (+    96us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:12.987259 (+   170us) server_negotiation.cc:300] Negotiation successful
1211 15:02:12.987357 (+    98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20251211 15:02:12.988883  6451 tablet_service.cc:3012] Rejecting scan request for tablet af04eb18835e4307805d1ea0980cc32b: Uninitialized: clean time has not yet been initialized
I20251211 15:02:12.990542  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 6408
I20251211 15:02:12.995761  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 6544
I20251211 15:02:13.000828  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 6680
I20251211 15:02:13.005656  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 6312
2025-12-11T15:02:13Z chronyd exiting
[       OK ] SecurityITest.TestAuthorizationOnChecksum (3154 ms)
[ RUN      ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:02:13 dist-test-slave-4k3m krb5kdc[6850](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:02:13 dist-test-slave-4k3m krb5kdc[6850](info): set up 2 sockets
Dec 11 15:02:13 dist-test-slave-4k3m krb5kdc[6850](info): commencing operation
krb5kdc: starting...
W20251211 15:02:14.855086  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.827s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:02:14 dist-test-slave-4k3m krb5kdc[6850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:02:14Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:02:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:14.990262  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:44001
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:44949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:44001
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:15.096892  6866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:15.097131  6866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:15.097190  6866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:15.100533  6866 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:02:15.100605  6866 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20251211 15:02:15.100622  6866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:15.100643  6866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:15.100661  6866 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:02:15.100683  6866 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:02:15.105086  6866 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:44949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:44001
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:44001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:15.106163  6866 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:15.107039  6866 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:15.113185  6871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:15.113269  6872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:15.113269  6874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:15.113647  6866 server_base.cc:1047] running on GCE node
I20251211 15:02:15.114172  6866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:15.115226  6866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:15.116422  6866 hybrid_clock.cc:648] HybridClock initialized: now 1765465335116412 us; error 32 us; skew 500 ppm
Dec 11 15:02:15 dist-test-slave-4k3m krb5kdc[6850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465335, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:15.119318  6866 init.cc:377] Logged in from keytab as kudu/127.5.160.190@KRBTEST.COM (short username kudu)
I20251211 15:02:15.120463  6866 webserver.cc:492] Webserver started at http://127.5.160.190:38431/ using document root <none> and password file <none>
I20251211 15:02:15.121006  6866 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:15.121057  6866 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:15.121229  6866 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:15.122905  6866 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "deb0fab8ed7c4052a2dd0266c2b99be2"
format_stamp: "Formatted at 2025-12-11 15:02:15 on dist-test-slave-4k3m"
server_key: "5cb77b3480959a3dca963d00b568a16c"
server_key_iv: "5b7fe791a2691c25138d1e17be96bb9a"
server_key_version: "encryptionkey@0"
I20251211 15:02:15.123406  6866 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "deb0fab8ed7c4052a2dd0266c2b99be2"
format_stamp: "Formatted at 2025-12-11 15:02:15 on dist-test-slave-4k3m"
server_key: "5cb77b3480959a3dca963d00b568a16c"
server_key_iv: "5b7fe791a2691c25138d1e17be96bb9a"
server_key_version: "encryptionkey@0"
I20251211 15:02:15.126752  6866 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20251211 15:02:15.129163  6881 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:15.130347  6866 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:02:15.130520  6866 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "deb0fab8ed7c4052a2dd0266c2b99be2"
format_stamp: "Formatted at 2025-12-11 15:02:15 on dist-test-slave-4k3m"
server_key: "5cb77b3480959a3dca963d00b568a16c"
server_key_iv: "5b7fe791a2691c25138d1e17be96bb9a"
server_key_version: "encryptionkey@0"
I20251211 15:02:15.130625  6866 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:15.142807  6866 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:15.145757  6866 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:15.145929  6866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:15.154470  6866 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:44001
I20251211 15:02:15.154769  6943 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:44001 every 8 connection(s)
I20251211 15:02:15.155556  6866 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:02:15.155901  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 6866
I20251211 15:02:15.155978  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:02:15.156220  5762 external_mini_cluster.cc:1468] Setting key 769d511eaabfb017e0bc172a9f428b46
I20251211 15:02:15.158766  6944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Dec 11 15:02:15 dist-test-slave-4k3m krb5kdc[6850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465334, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:15.165017  6944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2: Bootstrap starting.
I20251211 15:02:15.167354  6944 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:15.168265  6944 log.cc:826] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:15.169507  6947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.157406 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40576 (local address 127.5.160.190:44001)
1211 15:02:15.157781 (+   375us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:15.157790 (+     9us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:15.157825 (+    35us) server_negotiation.cc:408] Connection header received
1211 15:02:15.158457 (+   632us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:15.158474 (+    17us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:15.158852 (+   378us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:15.159190 (+   338us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:15.160223 (+  1033us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.161066 (+   843us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.161977 (+   911us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.162256 (+   279us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:15.164728 (+  2472us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:15.164778 (+    50us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:15.164789 (+    11us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:15.164845 (+    56us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:15.166587 (+  1742us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.167133 (+   546us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.167138 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.167143 (+     5us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.167237 (+    94us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.167523 (+   286us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.167526 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.167528 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.168008 (+   480us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:15.168232 (+   224us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:15.168536 (+   304us) server_negotiation.cc:300] Negotiation successful
1211 15:02:15.168812 (+   276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":109,"threads_started":1}
I20251211 15:02:15.170441  6944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2: No bootstrap required, opened a new log
I20251211 15:02:15.173537  6944 raft_consensus.cc:359] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb0fab8ed7c4052a2dd0266c2b99be2" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44001 } }
I20251211 15:02:15.173765  6944 raft_consensus.cc:385] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:15.173812  6944 raft_consensus.cc:740] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb0fab8ed7c4052a2dd0266c2b99be2, State: Initialized, Role: FOLLOWER
I20251211 15:02:15.174221  6944 consensus_queue.cc:260] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb0fab8ed7c4052a2dd0266c2b99be2" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44001 } }
I20251211 15:02:15.174333  6944 raft_consensus.cc:399] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:02:15.174387  6944 raft_consensus.cc:493] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:02:15.174474  6944 raft_consensus.cc:3060] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:15.175364  6944 raft_consensus.cc:515] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb0fab8ed7c4052a2dd0266c2b99be2" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44001 } }
I20251211 15:02:15.175705  6944 leader_election.cc:304] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: deb0fab8ed7c4052a2dd0266c2b99be2; no voters: 
I20251211 15:02:15.175980  6944 leader_election.cc:290] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:02:15.176173  6949 raft_consensus.cc:2804] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:15.176405  6949 raft_consensus.cc:697] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [term 1 LEADER]: Becoming Leader. State: Replica: deb0fab8ed7c4052a2dd0266c2b99be2, State: Running, Role: LEADER
I20251211 15:02:15.176741  6949 consensus_queue.cc:237] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb0fab8ed7c4052a2dd0266c2b99be2" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44001 } }
I20251211 15:02:15.177062  6944 sys_catalog.cc:565] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:02:15.178493  6951 sys_catalog.cc:455] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader deb0fab8ed7c4052a2dd0266c2b99be2. Latest consensus state: current_term: 1 leader_uuid: "deb0fab8ed7c4052a2dd0266c2b99be2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb0fab8ed7c4052a2dd0266c2b99be2" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44001 } } }
I20251211 15:02:15.178603  6951 sys_catalog.cc:458] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:15.178565  6950 sys_catalog.cc:455] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "deb0fab8ed7c4052a2dd0266c2b99be2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb0fab8ed7c4052a2dd0266c2b99be2" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44001 } } }
I20251211 15:02:15.178653  6950 sys_catalog.cc:458] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:15.178977  6958 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:02:15.182085  6958 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:02:15.187969  6958 catalog_manager.cc:1357] Generated new cluster ID: 0c30e0e168f24302b87d157e557b617b
I20251211 15:02:15.188062  6958 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:02:15.196662  6958 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:02:15.197999  6958 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:02:15.209878  6958 catalog_manager.cc:6027] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2: Generated new TSK 0
I20251211 15:02:15.210827  6958 catalog_manager.cc:1524] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:15.266296  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:44001
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:44949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:15.377622  6972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:15.377880  6972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:15.377965  6972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:15.381466  6972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:15.381554  6972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:15.381631  6972 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20251211 15:02:15.381700  6972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:02:15.386116  6972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:44949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--webserver_require_spnego=true
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.160.190:44001
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:15.387270  6972 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:15.388113  6972 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:15.395021  6980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:15.394972  6978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:15.395114  6972 server_base.cc:1047] running on GCE node
W20251211 15:02:15.394972  6977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:15.395720  6972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:15.396319  6972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:15.397550  6972 hybrid_clock.cc:648] HybridClock initialized: now 1765465335397533 us; error 37 us; skew 500 ppm
Dec 11 15:02:15 dist-test-slave-4k3m krb5kdc[6850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465335, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:15.400265  6972 init.cc:377] Logged in from keytab as kudu/127.5.160.129@KRBTEST.COM (short username kudu)
I20251211 15:02:15.401484  6972 webserver.cc:492] Webserver started at http://127.5.160.129:46183/ using document root <none> and password file <none>
I20251211 15:02:15.402060  6972 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:15.402109  6972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:15.402292  6972 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:15.404175  6972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "27401325960b4ae89950fc13aed5d31c"
format_stamp: "Formatted at 2025-12-11 15:02:15 on dist-test-slave-4k3m"
server_key: "ebb774a4a948ac0a951b07091f507e42"
server_key_iv: "c997267041867c61dc902ddb6ce69cff"
server_key_version: "encryptionkey@0"
I20251211 15:02:15.404681  6972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "27401325960b4ae89950fc13aed5d31c"
format_stamp: "Formatted at 2025-12-11 15:02:15 on dist-test-slave-4k3m"
server_key: "ebb774a4a948ac0a951b07091f507e42"
server_key_iv: "c997267041867c61dc902ddb6ce69cff"
server_key_version: "encryptionkey@0"
I20251211 15:02:15.408391  6972 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20251211 15:02:15.410904  6987 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:15.412189  6972 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:02:15.412312  6972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "27401325960b4ae89950fc13aed5d31c"
format_stamp: "Formatted at 2025-12-11 15:02:15 on dist-test-slave-4k3m"
server_key: "ebb774a4a948ac0a951b07091f507e42"
server_key_iv: "c997267041867c61dc902ddb6ce69cff"
server_key_version: "encryptionkey@0"
I20251211 15:02:15.412422  6972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:15.437379  6972 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:15.440512  6972 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:15.440689  6972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:15.442209  6972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:15.442266  6972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:15.442320  6972 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:15.442348  6972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
Dec 11 15:02:15 dist-test-slave-4k3m krb5kdc[6850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465335, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:15.453183  6972 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:34991
I20251211 15:02:15.453212  7102 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:34991 every 8 connection(s)
I20251211 15:02:15.454196  6972 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:02:15.455005  6947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.443076 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:48213 (local address 127.5.160.190:44001)
1211 15:02:15.443207 (+   131us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:15.443211 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:15.444026 (+   815us) server_negotiation.cc:408] Connection header received
1211 15:02:15.444902 (+   876us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:15.444906 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:15.444966 (+    60us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:15.445047 (+    81us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:15.446895 (+  1848us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.447498 (+   603us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.448161 (+   663us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.448343 (+   182us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:15.451023 (+  2680us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:15.451048 (+    25us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:15.451051 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:15.451094 (+    43us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:15.452694 (+  1600us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.453276 (+   582us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.453281 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.453282 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.453340 (+    58us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.453801 (+   461us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.453804 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.453806 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.453974 (+   168us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:15.454077 (+   103us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:15.454617 (+   540us) server_negotiation.cc:300] Negotiation successful
1211 15:02:15.454771 (+   154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20251211 15:02:15.455636  6996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.443364 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44001 (local address 127.5.160.129:48213)
1211 15:02:15.443871 (+   507us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:15.443909 (+    38us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:15.444677 (+   768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:15.445264 (+   587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:15.445276 (+    12us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:15.445910 (+   634us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:15.446700 (+   790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:15.446719 (+    19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.447623 (+   904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.447626 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:15.448047 (+   421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:15.448054 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.448282 (+   228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:15.449006 (+   724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:15.449046 (+    40us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:15.450832 (+  1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:15.452821 (+  1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:15.452828 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:15.452841 (+    13us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:15.453166 (+   325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:15.453417 (+   251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:15.453420 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:15.453422 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:15.453659 (+   237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:15.454095 (+   436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:15.454102 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:15.454363 (+   261us) client_negotiation.cc:769] Sending connection context
1211 15:02:15.454568 (+   205us) client_negotiation.cc:240] Negotiation successful
1211 15:02:15.454849 (+   281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":146,"threads_started":1}
I20251211 15:02:15.456939  7103 heartbeater.cc:344] Connected to a master server at 127.5.160.190:44001
I20251211 15:02:15.457099  7103 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:15.457653  7103 heartbeater.cc:507] Master 127.5.160.190:44001 requested a full tablet report, sending...
I20251211 15:02:15.459375  6897 ts_manager.cc:194] Registered new tserver with Master: 27401325960b4ae89950fc13aed5d31c (127.5.160.129:34991)
I20251211 15:02:15.460603  6897 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:48213
I20251211 15:02:15.462725  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 6972
I20251211 15:02:15.462826  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:02:15.463099  5762 external_mini_cluster.cc:1468] Setting key c19d5e8e83628620bf312d23357a5468
I20251211 15:02:15.468057  6947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.459025 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:36015 (local address 127.5.160.190:44001)
1211 15:02:15.459134 (+   109us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:15.459137 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:15.461365 (+  2228us) server_negotiation.cc:408] Connection header received
1211 15:02:15.461477 (+   112us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:15.461480 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:15.461536 (+    56us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:15.461623 (+    87us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:15.462226 (+   603us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.463044 (+   818us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.463791 (+   747us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.463971 (+   180us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:15.464823 (+   852us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:15.464839 (+    16us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:15.464841 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:15.464865 (+    24us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:15.466243 (+  1378us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.466739 (+   496us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.466746 (+     7us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.466748 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.466805 (+    57us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.467199 (+   394us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.467202 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.467203 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.467367 (+   164us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:15.467455 (+    88us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:15.467815 (+   360us) server_negotiation.cc:300] Negotiation successful
1211 15:02:15.467924 (+   109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20251211 15:02:15.468088  7109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.458961 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44001 (local address 127.5.160.129:36015)
1211 15:02:15.461257 (+  2296us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:15.461273 (+    16us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:15.461382 (+   109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:15.461685 (+   303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:15.461688 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:15.461888 (+   200us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:15.462099 (+   211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:15.462106 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.463182 (+  1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.463186 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:15.463681 (+   495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:15.463691 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.463793 (+   102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:15.464341 (+   548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:15.464358 (+    17us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:15.464700 (+   342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:15.466355 (+  1655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:15.466360 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:15.466362 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:15.466597 (+   235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:15.467026 (+   429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:15.467030 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:15.467032 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:15.467097 (+    65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:15.467455 (+   358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:15.467458 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:15.467612 (+   154us) client_negotiation.cc:769] Sending connection context
1211 15:02:15.467726 (+   114us) client_negotiation.cc:240] Negotiation successful
1211 15:02:15.467895 (+   169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2199,"thread_start_us":92,"threads_started":1}
WARNING: no policy specified for kudu/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:15.509119  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:44001
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:44949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:15.618908  7114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:15.619246  7114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:15.619356  7114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:15.622890  7114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:15.623016  7114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:15.623077  7114 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20251211 15:02:15.623119  7114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:02:15.627700  7114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:44949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--webserver_require_spnego=true
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.160.190:44001
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:15.628880  7114 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:15.629735  7114 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:15.636762  7120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:15.636765  7122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:15.636765  7119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:15.637003  7114 server_base.cc:1047] running on GCE node
I20251211 15:02:15.637457  7114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:15.638055  7114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:15.639254  7114 hybrid_clock.cc:648] HybridClock initialized: now 1765465335639229 us; error 40 us; skew 500 ppm
Dec 11 15:02:15 dist-test-slave-4k3m krb5kdc[6850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465335, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:15.641968  7114 init.cc:377] Logged in from keytab as kudu/127.5.160.130@KRBTEST.COM (short username kudu)
I20251211 15:02:15.643163  7114 webserver.cc:492] Webserver started at http://127.5.160.130:44649/ using document root <none> and password file <none>
I20251211 15:02:15.643777  7114 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:15.643829  7114 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:15.643985  7114 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:15.645709  7114 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "25e73e07180c4bb58042a9f262b3bd13"
format_stamp: "Formatted at 2025-12-11 15:02:15 on dist-test-slave-4k3m"
server_key: "daf3943a8ffeb71d1bbe088f13cf0152"
server_key_iv: "005b7a70a2ef2d9fb522c9c55dcc689d"
server_key_version: "encryptionkey@0"
I20251211 15:02:15.646139  7114 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "25e73e07180c4bb58042a9f262b3bd13"
format_stamp: "Formatted at 2025-12-11 15:02:15 on dist-test-slave-4k3m"
server_key: "daf3943a8ffeb71d1bbe088f13cf0152"
server_key_iv: "005b7a70a2ef2d9fb522c9c55dcc689d"
server_key_version: "encryptionkey@0"
I20251211 15:02:15.649775  7114 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.005s
I20251211 15:02:15.652174  7129 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:15.653254  7114 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:02:15.653362  7114 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "25e73e07180c4bb58042a9f262b3bd13"
format_stamp: "Formatted at 2025-12-11 15:02:15 on dist-test-slave-4k3m"
server_key: "daf3943a8ffeb71d1bbe088f13cf0152"
server_key_iv: "005b7a70a2ef2d9fb522c9c55dcc689d"
server_key_version: "encryptionkey@0"
I20251211 15:02:15.653460  7114 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:15.669332  7114 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:15.672627  7114 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:15.672807  7114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:15.674315  7114 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:15.674371  7114 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:15.674427  7114 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:15.674453  7114 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
Dec 11 15:02:15 dist-test-slave-4k3m krb5kdc[6850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465335, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:15.685710  7114 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:34781
I20251211 15:02:15.685729  7244 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:34781 every 8 connection(s)
I20251211 15:02:15.686663  7114 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:02:15.687301  6947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.675019 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:58781 (local address 127.5.160.190:44001)
1211 15:02:15.675144 (+   125us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:15.675147 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:15.676175 (+  1028us) server_negotiation.cc:408] Connection header received
1211 15:02:15.677111 (+   936us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:15.677115 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:15.677179 (+    64us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:15.677251 (+    72us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:15.679001 (+  1750us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.679740 (+   739us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.680429 (+   689us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.680642 (+   213us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:15.683362 (+  2720us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:15.683389 (+    27us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:15.683393 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:15.683429 (+    36us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:15.685154 (+  1725us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.685792 (+   638us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.685796 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.685798 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.685856 (+    58us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.686157 (+   301us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.686161 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.686162 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.686325 (+   163us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:15.686416 (+    91us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:15.687005 (+   589us) server_negotiation.cc:300] Negotiation successful
1211 15:02:15.687136 (+   131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20251211 15:02:15.687899  7138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.675405 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44001 (local address 127.5.160.130:58781)
1211 15:02:15.676013 (+   608us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:15.676055 (+    42us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:15.676898 (+   843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:15.677444 (+   546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:15.677464 (+    20us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:15.678122 (+   658us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:15.678749 (+   627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:15.678764 (+    15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.679879 (+  1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.679882 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:15.680307 (+   425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:15.680317 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.680564 (+   247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:15.681280 (+   716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:15.681318 (+    38us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:15.683187 (+  1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:15.685322 (+  2135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:15.685328 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:15.685340 (+    12us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:15.685660 (+   320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:15.685956 (+   296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:15.685959 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:15.685961 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:15.686056 (+    95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:15.686425 (+   369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:15.686433 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:15.686721 (+   288us) client_negotiation.cc:769] Sending connection context
1211 15:02:15.686915 (+   194us) client_negotiation.cc:240] Negotiation successful
1211 15:02:15.687211 (+   296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":168,"threads_started":1}
I20251211 15:02:15.689018  7245 heartbeater.cc:344] Connected to a master server at 127.5.160.190:44001
I20251211 15:02:15.689190  7245 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:15.689762  7245 heartbeater.cc:507] Master 127.5.160.190:44001 requested a full tablet report, sending...
I20251211 15:02:15.690761  6898 ts_manager.cc:194] Registered new tserver with Master: 25e73e07180c4bb58042a9f262b3bd13 (127.5.160.130:34781)
I20251211 15:02:15.691485  6898 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.130@KRBTEST.COM'} at 127.5.160.130:58781
I20251211 15:02:15.695178  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 7114
I20251211 15:02:15.695289  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:02:15.695601  5762 external_mini_cluster.cc:1468] Setting key f0d9be10a5d49d37319422a539e52b78
I20251211 15:02:15.698223  6947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.691766 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:36631 (local address 127.5.160.190:44001)
1211 15:02:15.691927 (+   161us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:15.691931 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:15.691944 (+    13us) server_negotiation.cc:408] Connection header received
1211 15:02:15.691976 (+    32us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:15.691979 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:15.692023 (+    44us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:15.692103 (+    80us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:15.692765 (+   662us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.693249 (+   484us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.693939 (+   690us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.694086 (+   147us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:15.694858 (+   772us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:15.694877 (+    19us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:15.694887 (+    10us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:15.694921 (+    34us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:15.696516 (+  1595us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.696971 (+   455us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.696975 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.696976 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.697036 (+    60us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.697369 (+   333us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.697372 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.697374 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.697563 (+   189us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:15.697654 (+    91us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:15.697994 (+   340us) server_negotiation.cc:300] Negotiation successful
1211 15:02:15.698105 (+   111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20251211 15:02:15.698256  7251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.690862 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44001 (local address 127.5.160.130:36631)
1211 15:02:15.691153 (+   291us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:15.691167 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:15.691268 (+   101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:15.692141 (+   873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:15.692144 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:15.692337 (+   193us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:15.692617 (+   280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:15.692627 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.693361 (+   734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.693365 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:15.693827 (+   462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:15.693835 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.693928 (+    93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:15.694441 (+   513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:15.694454 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:15.694739 (+   285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:15.696649 (+  1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:15.696652 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:15.696654 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:15.696863 (+   209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:15.697162 (+   299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:15.697166 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:15.697168 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:15.697244 (+    76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:15.697682 (+   438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:15.697686 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:15.697813 (+   127us) client_negotiation.cc:769] Sending connection context
1211 15:02:15.697921 (+   108us) client_negotiation.cc:240] Negotiation successful
1211 15:02:15.698067 (+   146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":120,"threads_started":1}
WARNING: no policy specified for kudu/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:15.745740  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:44001
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:44949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:15.852105  7256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:15.852350  7256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:15.852408  7256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:15.855696  7256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:15.855779  7256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:15.855835  7256 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20251211 15:02:15.855875  7256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:02:15.860283  7256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:44949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--webserver_require_spnego=true
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.160.190:44001
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:15.861380  7256 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:15.862206  7256 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:15.868863  7262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:15.868918  7264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:15.868939  7261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:15.869102  7256 server_base.cc:1047] running on GCE node
I20251211 15:02:15.869442  7256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:15.869977  7256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:15.871120  7256 hybrid_clock.cc:648] HybridClock initialized: now 1765465335871098 us; error 36 us; skew 500 ppm
Dec 11 15:02:15 dist-test-slave-4k3m krb5kdc[6850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465335, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:15.876576  7256 init.cc:377] Logged in from keytab as kudu/127.5.160.131@KRBTEST.COM (short username kudu)
I20251211 15:02:15.877782  7256 webserver.cc:492] Webserver started at http://127.5.160.131:33805/ using document root <none> and password file <none>
I20251211 15:02:15.878391  7256 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:15.878448  7256 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:15.878625  7256 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:15.880548  7256 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "15d3ba15ab3a4c39a408d52a832e734f"
format_stamp: "Formatted at 2025-12-11 15:02:15 on dist-test-slave-4k3m"
server_key: "aa607342b361031b0b850dea8112e669"
server_key_iv: "cd80cfdcd1b5d649b7fcaebe8f5bae42"
server_key_version: "encryptionkey@0"
I20251211 15:02:15.881078  7256 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "15d3ba15ab3a4c39a408d52a832e734f"
format_stamp: "Formatted at 2025-12-11 15:02:15 on dist-test-slave-4k3m"
server_key: "aa607342b361031b0b850dea8112e669"
server_key_iv: "cd80cfdcd1b5d649b7fcaebe8f5bae42"
server_key_version: "encryptionkey@0"
I20251211 15:02:15.884788  7256 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20251211 15:02:15.887285  7271 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:15.888341  7256 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20251211 15:02:15.888504  7256 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "15d3ba15ab3a4c39a408d52a832e734f"
format_stamp: "Formatted at 2025-12-11 15:02:15 on dist-test-slave-4k3m"
server_key: "aa607342b361031b0b850dea8112e669"
server_key_iv: "cd80cfdcd1b5d649b7fcaebe8f5bae42"
server_key_version: "encryptionkey@0"
I20251211 15:02:15.888599  7256 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:15.925300  7256 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:15.928423  7256 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:15.928606  7256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:15.930089  7256 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:15.930142  7256 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:15.930181  7256 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:15.930197  7256 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
Dec 11 15:02:15 dist-test-slave-4k3m krb5kdc[6850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465335, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:15.940287  7256 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:37067
I20251211 15:02:15.940616  7386 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:37067 every 8 connection(s)
I20251211 15:02:15.941256  7256 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
I20251211 15:02:15.941934  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 7256
I20251211 15:02:15.942041  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:02:15.942292  5762 external_mini_cluster.cc:1468] Setting key 804a5968994b293121af27c0ab38cc43
I20251211 15:02:15.943725  6947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.931044 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:44811 (local address 127.5.160.190:44001)
1211 15:02:15.931194 (+   150us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:15.931199 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:15.932003 (+   804us) server_negotiation.cc:408] Connection header received
1211 15:02:15.933095 (+  1092us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:15.933101 (+     6us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:15.933169 (+    68us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:15.933275 (+   106us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:15.934795 (+  1520us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.935494 (+   699us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.936185 (+   691us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.936368 (+   183us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:15.939974 (+  3606us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:15.940001 (+    27us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:15.940005 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:15.940038 (+    33us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:15.941523 (+  1485us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.942042 (+   519us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.942045 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.942047 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.942102 (+    55us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.942392 (+   290us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.942396 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.942398 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.942609 (+   211us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:15.942724 (+   115us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:15.943434 (+   710us) server_negotiation.cc:300] Negotiation successful
1211 15:02:15.943609 (+   175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20251211 15:02:15.944466  7280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.931330 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44001 (local address 127.5.160.131:44811)
1211 15:02:15.931838 (+   508us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:15.931882 (+    44us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:15.932785 (+   903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:15.933475 (+   690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:15.933488 (+    13us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:15.933951 (+   463us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:15.934611 (+   660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:15.934630 (+    19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.935622 (+   992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.935627 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:15.936057 (+   430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:15.936065 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.936308 (+   243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:15.937007 (+   699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:15.937043 (+    36us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:15.939795 (+  2752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:15.941657 (+  1862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:15.941663 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:15.941675 (+    12us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:15.941942 (+   267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:15.942204 (+   262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:15.942207 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:15.942209 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:15.942309 (+   100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:15.942783 (+   474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:15.942790 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:15.943104 (+   314us) client_negotiation.cc:769] Sending connection context
1211 15:02:15.943376 (+   272us) client_negotiation.cc:240] Negotiation successful
1211 15:02:15.943679 (+   303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":154,"threads_started":1}
I20251211 15:02:15.945379  7387 heartbeater.cc:344] Connected to a master server at 127.5.160.190:44001
I20251211 15:02:15.945524  7387 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:15.946004  7387 heartbeater.cc:507] Master 127.5.160.190:44001 requested a full tablet report, sending...
I20251211 15:02:15.946972  6897 ts_manager.cc:194] Registered new tserver with Master: 15d3ba15ab3a4c39a408d52a832e734f (127.5.160.131:37067)
I20251211 15:02:15.947625  6897 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.131@KRBTEST.COM'} at 127.5.160.131:44811
I20251211 15:02:15.953891  7393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.947377 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44001 (local address 127.5.160.131:44937)
1211 15:02:15.947621 (+   244us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:15.947635 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:15.947732 (+    97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:15.947989 (+   257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:15.947993 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:15.948153 (+   160us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:15.948355 (+   202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:15.948361 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.949133 (+   772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.949136 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:15.949528 (+   392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:15.949536 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.949639 (+   103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:15.950190 (+   551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:15.950202 (+    12us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:15.950500 (+   298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:15.952330 (+  1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:15.952333 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:15.952335 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:15.952631 (+   296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:15.952916 (+   285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:15.952919 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:15.952921 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:15.952971 (+    50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:15.953365 (+   394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:15.953368 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:15.953458 (+    90us) client_negotiation.cc:769] Sending connection context
1211 15:02:15.953605 (+   147us) client_negotiation.cc:240] Negotiation successful
1211 15:02:15.953721 (+   116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":81,"threads_started":1}
I20251211 15:02:15.953922  6947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.947499 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:44937 (local address 127.5.160.190:44001)
1211 15:02:15.947614 (+   115us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:15.947619 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:15.947709 (+    90us) server_negotiation.cc:408] Connection header received
1211 15:02:15.947830 (+   121us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:15.947833 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:15.947879 (+    46us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:15.947950 (+    71us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:15.948459 (+   509us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.949004 (+   545us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.949636 (+   632us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.949813 (+   177us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:15.950622 (+   809us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:15.950644 (+    22us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:15.950646 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:15.950668 (+    22us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:15.952205 (+  1537us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.952750 (+   545us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.952753 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.952755 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.952803 (+    48us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.953084 (+   281us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.953087 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.953089 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.953251 (+   162us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:15.953343 (+    92us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:15.953683 (+   340us) server_negotiation.cc:300] Negotiation successful
1211 15:02:15.953797 (+   114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20251211 15:02:15.956058  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
Dec 11 15:02:15 dist-test-slave-4k3m krb5kdc[6850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465335, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM: 
Dec 11 15:02:15 dist-test-slave-4k3m krb5kdc[6850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465335, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:15.980129  6947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.972292 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40588 (local address 127.5.160.190:44001)
1211 15:02:15.972426 (+   134us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:15.972430 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:15.972485 (+    55us) server_negotiation.cc:408] Connection header received
1211 15:02:15.972523 (+    38us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:15.972526 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:15.972568 (+    42us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:15.972644 (+    76us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:15.973515 (+   871us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.974011 (+   496us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.974631 (+   620us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.974813 (+   182us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:15.977016 (+  2203us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:15.977038 (+    22us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:15.977040 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:15.977071 (+    31us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:15.978533 (+  1462us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.978990 (+   457us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.978993 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.978995 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.979045 (+    50us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:15.979284 (+   239us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:15.979287 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:15.979290 (+     3us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:15.979521 (+   231us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:15.979643 (+   122us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:15.979855 (+   212us) server_negotiation.cc:300] Negotiation successful
1211 15:02:15.979968 (+   113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20251211 15:02:15.983184  6897 catalog_manager.cc:2257] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40588:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20251211 15:02:15.985553  6897 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:02:16.001120  7407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.996493 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:34781 (local address 127.0.0.1:59946)
1211 15:02:15.997234 (+   741us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:15.997248 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:15.997323 (+    75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:15.998048 (+   725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:15.998052 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:15.998067 (+    15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:15.998295 (+   228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:15.998301 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.999579 (+  1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.999583 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:16.000564 (+   981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:16.000574 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.000683 (+   109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.000760 (+    77us) client_negotiation.cc:769] Sending connection context
1211 15:02:16.000858 (+    98us) client_negotiation.cc:240] Negotiation successful
1211 15:02:16.000962 (+   104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":98,"threads_started":1}
I20251211 15:02:16.001538  7405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.996170 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:34991 (local address 127.0.0.1:38770)
1211 15:02:15.996712 (+   542us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:15.996753 (+    41us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:15.996916 (+   163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:15.997832 (+   916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:15.997838 (+     6us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:15.997859 (+    21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:15.998163 (+   304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:15.998171 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.999562 (+  1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.999566 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:16.000582 (+  1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:16.000589 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.000722 (+   133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.000760 (+    38us) client_negotiation.cc:769] Sending connection context
1211 15:02:16.000858 (+    98us) client_negotiation.cc:240] Negotiation successful
1211 15:02:16.000962 (+   104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"spinlock_wait_cycles":2176,"thread_start_us":101,"threads_started":1}
I20251211 15:02:16.001839  7404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.995726 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:37067 (local address 127.0.0.1:60842)
1211 15:02:15.996723 (+   997us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:15.996754 (+    31us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:15.996917 (+   163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:15.998122 (+  1205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:15.998126 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:15.998143 (+    17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:15.998374 (+   231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:15.998382 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.999915 (+  1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:15.999919 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:16.000972 (+  1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:16.000984 (+    12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.001555 (+   571us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.001584 (+    29us) client_negotiation.cc:769] Sending connection context
1211 15:02:16.001648 (+    64us) client_negotiation.cc:240] Negotiation successful
1211 15:02:16.001713 (+    65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":810,"spinlock_wait_cycles":16896,"thread_start_us":100,"threads_started":1}
I20251211 15:02:16.002630  7409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.997149 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59946 (local address 127.5.160.130:34781)
1211 15:02:15.997613 (+   464us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:15.997621 (+     8us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:15.997644 (+    23us) server_negotiation.cc:408] Connection header received
1211 15:02:15.997732 (+    88us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:15.997737 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:15.997912 (+   175us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:15.998058 (+   146us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:15.998400 (+   342us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.999444 (+  1044us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.001721 (+  2277us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.002221 (+   500us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.002333 (+   112us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:16.002399 (+    66us) server_negotiation.cc:300] Negotiation successful
1211 15:02:16.002493 (+    94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":111,"threads_started":1}
I20251211 15:02:16.003085  7406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.996297 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38770 (local address 127.5.160.129:34991)
1211 15:02:15.996658 (+   361us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:15.996665 (+     7us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:15.996838 (+   173us) server_negotiation.cc:408] Connection header received
1211 15:02:15.997473 (+   635us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:15.997481 (+     8us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:15.997693 (+   212us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:15.997825 (+   132us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:15.998276 (+   451us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.999434 (+  1158us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.001042 (+  1608us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.001663 (+   621us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.001793 (+   130us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:16.002821 (+  1028us) server_negotiation.cc:300] Negotiation successful
1211 15:02:16.002965 (+   144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":87,"threads_started":1}
I20251211 15:02:16.003157  7408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:15.997047 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60842 (local address 127.5.160.131:37067)
1211 15:02:15.997622 (+   575us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:15.997627 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:15.997645 (+    18us) server_negotiation.cc:408] Connection header received
1211 15:02:15.997851 (+   206us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:15.997855 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:15.997977 (+   122us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:15.998516 (+   539us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:15.998666 (+   150us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:15.999806 (+  1140us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.002112 (+  2306us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.002660 (+   548us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.002766 (+   106us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:16.002831 (+    65us) server_negotiation.cc:300] Negotiation successful
1211 15:02:16.002920 (+    89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":86,"threads_started":1}
I20251211 15:02:16.005661  7037 tablet_service.cc:1505] Processing CreateTablet for tablet 126c3a06b1544ac6add9f1da6adeb497 (DEFAULT_TABLE table=test-table [id=2193b0cf504948b181c6f52e17b5e46d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:16.006750  7037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 126c3a06b1544ac6add9f1da6adeb497. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:16.009217  7321 tablet_service.cc:1505] Processing CreateTablet for tablet 126c3a06b1544ac6add9f1da6adeb497 (DEFAULT_TABLE table=test-table [id=2193b0cf504948b181c6f52e17b5e46d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:16.010295  7321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 126c3a06b1544ac6add9f1da6adeb497. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:16.014065  7410 tablet_bootstrap.cc:492] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c: Bootstrap starting.
I20251211 15:02:16.016649  7410 tablet_bootstrap.cc:654] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:16.017690  7410 log.cc:826] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:16.017664  7179 tablet_service.cc:1505] Processing CreateTablet for tablet 126c3a06b1544ac6add9f1da6adeb497 (DEFAULT_TABLE table=test-table [id=2193b0cf504948b181c6f52e17b5e46d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:16.018491  7411 tablet_bootstrap.cc:492] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f: Bootstrap starting.
I20251211 15:02:16.018765  7179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 126c3a06b1544ac6add9f1da6adeb497. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:16.019826  7410 tablet_bootstrap.cc:492] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c: No bootstrap required, opened a new log
I20251211 15:02:16.020035  7410 ts_tablet_manager.cc:1403] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20251211 15:02:16.020887  7411 tablet_bootstrap.cc:654] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:16.022125  7411 log.cc:826] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:16.023313  7410 raft_consensus.cc:359] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } }
I20251211 15:02:16.023547  7410 raft_consensus.cc:385] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:16.023612  7410 raft_consensus.cc:740] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27401325960b4ae89950fc13aed5d31c, State: Initialized, Role: FOLLOWER
I20251211 15:02:16.024138  7410 consensus_queue.cc:260] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } }
I20251211 15:02:16.024700  7414 tablet_bootstrap.cc:492] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13: Bootstrap starting.
I20251211 15:02:16.025060  7410 ts_tablet_manager.cc:1434] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20251211 15:02:16.025240  7411 tablet_bootstrap.cc:492] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f: No bootstrap required, opened a new log
I20251211 15:02:16.025449  7411 ts_tablet_manager.cc:1403] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f: Time spent bootstrapping tablet: real 0.007s	user 0.005s	sys 0.000s
I20251211 15:02:16.025540  7103 heartbeater.cc:499] Master 127.5.160.190:44001 was elected leader, sending a full tablet report...
I20251211 15:02:16.027349  7414 tablet_bootstrap.cc:654] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:16.028705  7414 log.cc:826] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:16.030230  7411 raft_consensus.cc:359] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } }
I20251211 15:02:16.030555  7411 raft_consensus.cc:385] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:16.030632  7411 raft_consensus.cc:740] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15d3ba15ab3a4c39a408d52a832e734f, State: Initialized, Role: FOLLOWER
I20251211 15:02:16.031220  7411 consensus_queue.cc:260] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } }
I20251211 15:02:16.031817  7414 tablet_bootstrap.cc:492] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13: No bootstrap required, opened a new log
I20251211 15:02:16.032008  7414 ts_tablet_manager.cc:1403] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13: Time spent bootstrapping tablet: real 0.008s	user 0.005s	sys 0.000s
I20251211 15:02:16.032203  7411 ts_tablet_manager.cc:1434] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20251211 15:02:16.032614  7387 heartbeater.cc:499] Master 127.5.160.190:44001 was elected leader, sending a full tablet report...
I20251211 15:02:16.034806  7414 raft_consensus.cc:359] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } }
I20251211 15:02:16.035077  7414 raft_consensus.cc:385] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:16.035137  7414 raft_consensus.cc:740] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25e73e07180c4bb58042a9f262b3bd13, State: Initialized, Role: FOLLOWER
I20251211 15:02:16.035588  7414 consensus_queue.cc:260] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } }
I20251211 15:02:16.036244  7245 heartbeater.cc:499] Master 127.5.160.190:44001 was elected leader, sending a full tablet report...
I20251211 15:02:16.036424  7414 ts_tablet_manager.cc:1434] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20251211 15:02:16.067497  7415 raft_consensus.cc:493] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:02:16.067705  7415 raft_consensus.cc:515] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } }
I20251211 15:02:16.068809  7415 leader_election.cc:290] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15d3ba15ab3a4c39a408d52a832e734f (127.5.160.131:37067), 25e73e07180c4bb58042a9f262b3bd13 (127.5.160.130:34781)
I20251211 15:02:16.072955  7420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:16.069606 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:34781 (local address 127.5.160.129:40465)
1211 15:02:16.069910 (+   304us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:16.069923 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:16.070045 (+   122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:16.070262 (+   217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:16.070266 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:16.070286 (+    20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:16.070649 (+   363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:16.070658 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.071769 (+  1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.071773 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:16.072544 (+   771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:16.072553 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.072667 (+   114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.072690 (+    23us) client_negotiation.cc:769] Sending connection context
1211 15:02:16.072741 (+    51us) client_negotiation.cc:240] Negotiation successful
1211 15:02:16.072803 (+    62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"spinlock_wait_cycles":768,"thread_start_us":130,"threads_started":1}
I20251211 15:02:16.073433  7409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:16.069723 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:40465 (local address 127.5.160.130:34781)
1211 15:02:16.069894 (+   171us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:16.069898 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:16.069995 (+    97us) server_negotiation.cc:408] Connection header received
1211 15:02:16.070135 (+   140us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:16.070138 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:16.070177 (+    39us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:16.070235 (+    58us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:16.070757 (+   522us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.071589 (+   832us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.072667 (+  1078us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.073168 (+   501us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.073206 (+    38us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:16.073258 (+    52us) server_negotiation.cc:300] Negotiation successful
1211 15:02:16.073317 (+    59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20251211 15:02:16.073559  7419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:16.069141 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:37067 (local address 127.5.160.129:59193)
1211 15:02:16.069486 (+   345us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:16.069500 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:16.069661 (+   161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:16.069946 (+   285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:16.069950 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:16.069980 (+    30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:16.070809 (+   829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:16.070819 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.071787 (+   968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.071790 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:16.072510 (+   720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:16.072520 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.073268 (+   748us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.073285 (+    17us) client_negotiation.cc:769] Sending connection context
1211 15:02:16.073381 (+    96us) client_negotiation.cc:240] Negotiation successful
1211 15:02:16.073438 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"spinlock_wait_cycles":11648,"thread_start_us":158,"threads_started":1}
I20251211 15:02:16.073647  7408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:16.069209 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:59193 (local address 127.5.160.131:37067)
1211 15:02:16.069360 (+   151us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:16.069366 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:16.069611 (+   245us) server_negotiation.cc:408] Connection header received
1211 15:02:16.069765 (+   154us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:16.069769 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:16.069821 (+    52us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:16.069892 (+    71us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:16.070952 (+  1060us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.071672 (+   720us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.072658 (+   986us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.073168 (+   510us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.073206 (+    38us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:16.073447 (+   241us) server_negotiation.cc:300] Negotiation successful
1211 15:02:16.073532 (+    85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20251211 15:02:16.074007  7199 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "126c3a06b1544ac6add9f1da6adeb497" candidate_uuid: "27401325960b4ae89950fc13aed5d31c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25e73e07180c4bb58042a9f262b3bd13" is_pre_election: true
I20251211 15:02:16.074168  7341 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "126c3a06b1544ac6add9f1da6adeb497" candidate_uuid: "27401325960b4ae89950fc13aed5d31c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15d3ba15ab3a4c39a408d52a832e734f" is_pre_election: true
I20251211 15:02:16.074308  7199 raft_consensus.cc:2468] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27401325960b4ae89950fc13aed5d31c in term 0.
I20251211 15:02:16.074365  7341 raft_consensus.cc:2468] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27401325960b4ae89950fc13aed5d31c in term 0.
I20251211 15:02:16.074786  6991 leader_election.cc:304] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25e73e07180c4bb58042a9f262b3bd13, 27401325960b4ae89950fc13aed5d31c; no voters: 
I20251211 15:02:16.075066  7415 raft_consensus.cc:2804] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:02:16.075145  7415 raft_consensus.cc:493] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:02:16.075186  7415 raft_consensus.cc:3060] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:16.076135  7415 raft_consensus.cc:515] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } }
I20251211 15:02:16.076491  7415 leader_election.cc:290] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [CANDIDATE]: Term 1 election: Requested vote from peers 15d3ba15ab3a4c39a408d52a832e734f (127.5.160.131:37067), 25e73e07180c4bb58042a9f262b3bd13 (127.5.160.130:34781)
I20251211 15:02:16.076961  7199 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "126c3a06b1544ac6add9f1da6adeb497" candidate_uuid: "27401325960b4ae89950fc13aed5d31c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25e73e07180c4bb58042a9f262b3bd13"
I20251211 15:02:16.076961  7341 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "126c3a06b1544ac6add9f1da6adeb497" candidate_uuid: "27401325960b4ae89950fc13aed5d31c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15d3ba15ab3a4c39a408d52a832e734f"
I20251211 15:02:16.077092  7199 raft_consensus.cc:3060] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:16.077092  7341 raft_consensus.cc:3060] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:16.078351  7341 raft_consensus.cc:2468] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27401325960b4ae89950fc13aed5d31c in term 1.
I20251211 15:02:16.078351  7199 raft_consensus.cc:2468] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27401325960b4ae89950fc13aed5d31c in term 1.
I20251211 15:02:16.078696  6991 leader_election.cc:304] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25e73e07180c4bb58042a9f262b3bd13, 27401325960b4ae89950fc13aed5d31c; no voters: 
I20251211 15:02:16.078876  7415 raft_consensus.cc:2804] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:16.079115  7415 raft_consensus.cc:697] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [term 1 LEADER]: Becoming Leader. State: Replica: 27401325960b4ae89950fc13aed5d31c, State: Running, Role: LEADER
I20251211 15:02:16.079461  7415 consensus_queue.cc:237] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } }
I20251211 15:02:16.082978  6897 catalog_manager.cc:5654] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c reported cstate change: term changed from 0 to 1, leader changed from <none> to 27401325960b4ae89950fc13aed5d31c (127.5.160.129). New cstate: current_term: 1 leader_uuid: "27401325960b4ae89950fc13aed5d31c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } health_report { overall_health: HEALTHY } } }
I20251211 15:02:16.103526  7406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:16.100393 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38776 (local address 127.5.160.129:34991)
1211 15:02:16.100554 (+   161us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:16.100559 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:16.100576 (+    17us) server_negotiation.cc:408] Connection header received
1211 15:02:16.100786 (+   210us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:16.100789 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:16.100847 (+    58us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:16.100930 (+    83us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:02:16.101272 (+   342us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.101766 (+   494us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.102390 (+   624us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.102587 (+   197us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.102643 (+    56us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:02:16.103143 (+   500us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:02:16.103245 (+   102us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:16.103336 (+    91us) server_negotiation.cc:300] Negotiation successful
1211 15:02:16.103389 (+    53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20251211 15:02:16.109223  7341 raft_consensus.cc:1275] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f [term 1 FOLLOWER]: Refusing update from remote peer 27401325960b4ae89950fc13aed5d31c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:16.109223  7199 raft_consensus.cc:1275] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13 [term 1 FOLLOWER]: Refusing update from remote peer 27401325960b4ae89950fc13aed5d31c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:16.109937  7421 consensus_queue.cc:1048] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [LEADER]: Connected to new peer: Peer: permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:16.110126  7415 consensus_queue.cc:1048] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [LEADER]: Connected to new peer: Peer: permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:16.116962  7424 mvcc.cc:204] Tried to move back new op lower bound from 7231346016695881728 to 7231346016584450048. Current Snapshot: MvccSnapshot[applied={T|T < 7231346016695881728}]
I20251211 15:02:16.118530  7425 mvcc.cc:204] Tried to move back new op lower bound from 7231346016695881728 to 7231346016584450048. Current Snapshot: MvccSnapshot[applied={T|T < 7231346016695881728}]
I20251211 15:02:16.128266  6897 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40588:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:16.128448  6897 catalog_manager.cc:2755] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40588:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:16.131033  6897 catalog_manager.cc:5941] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2: Sending DeleteTablet for 3 replicas of tablet 126c3a06b1544ac6add9f1da6adeb497
I20251211 15:02:16.131927  7179 tablet_service.cc:1552] Processing DeleteTablet for tablet 126c3a06b1544ac6add9f1da6adeb497 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:16 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:59946
I20251211 15:02:16.131927  7321 tablet_service.cc:1552] Processing DeleteTablet for tablet 126c3a06b1544ac6add9f1da6adeb497 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:16 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:60842
I20251211 15:02:16.131922  7037 tablet_service.cc:1552] Processing DeleteTablet for tablet 126c3a06b1544ac6add9f1da6adeb497 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:16 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:38770
I20251211 15:02:16.132496  7435 tablet_replica.cc:333] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13: stopping tablet replica
I20251211 15:02:16.132715  6897 catalog_manager.cc:2257] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40588:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20251211 15:02:16.132802  7435 raft_consensus.cc:2243] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:02:16.133139  7435 raft_consensus.cc:2272] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251211 15:02:16.133173  6897 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:02:16.133553  7434 tablet_replica.cc:333] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f: stopping tablet replica
I20251211 15:02:16.133800  7434 raft_consensus.cc:2243] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:02:16.134064  7434 raft_consensus.cc:2272] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:16.136116  7435 ts_tablet_manager.cc:1916] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:16.136556  7436 tablet_replica.cc:333] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c: stopping tablet replica
I20251211 15:02:16.137107  7436 raft_consensus.cc:2243] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [term 1 LEADER]: Raft consensus shutting down.
I20251211 15:02:16.137698  7436 raft_consensus.cc:2272] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:16.138365  7037 tablet_service.cc:1505] Processing CreateTablet for tablet d757611f6eb94bd789709bd8a4cba4bc (DEFAULT_TABLE table=test-table [id=64c5832de41644ea8e49381462422f8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:16.138630  7037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d757611f6eb94bd789709bd8a4cba4bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:16.138708  7179 tablet_service.cc:1505] Processing CreateTablet for tablet d757611f6eb94bd789709bd8a4cba4bc (DEFAULT_TABLE table=test-table [id=64c5832de41644ea8e49381462422f8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:16.138790  7321 tablet_service.cc:1505] Processing CreateTablet for tablet d757611f6eb94bd789709bd8a4cba4bc (DEFAULT_TABLE table=test-table [id=64c5832de41644ea8e49381462422f8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:16.138953  7179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d757611f6eb94bd789709bd8a4cba4bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:16.139222  7321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d757611f6eb94bd789709bd8a4cba4bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:16.140961  7414 tablet_bootstrap.cc:492] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13: Bootstrap starting.
I20251211 15:02:16.140961  7410 tablet_bootstrap.cc:492] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c: Bootstrap starting.
I20251211 15:02:16.141978  7414 tablet_bootstrap.cc:654] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:16.141978  7410 tablet_bootstrap.cc:654] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:16.142913  7411 tablet_bootstrap.cc:492] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f: Bootstrap starting.
I20251211 15:02:16.143344  7410 tablet_bootstrap.cc:492] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c: No bootstrap required, opened a new log
I20251211 15:02:16.143437  7410 ts_tablet_manager.cc:1403] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20251211 15:02:16.143918  7411 tablet_bootstrap.cc:654] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:16.143918  7410 raft_consensus.cc:359] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.144049  7410 raft_consensus.cc:385] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:16.144083  7410 raft_consensus.cc:740] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27401325960b4ae89950fc13aed5d31c, State: Initialized, Role: FOLLOWER
I20251211 15:02:16.144208  7410 consensus_queue.cc:260] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.145825  7411 tablet_bootstrap.cc:492] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f: No bootstrap required, opened a new log
I20251211 15:02:16.145931  7411 ts_tablet_manager.cc:1403] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f: Time spent bootstrapping tablet: real 0.003s	user 0.000s	sys 0.002s
I20251211 15:02:16.145992  7410 ts_tablet_manager.cc:1434] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.001s
I20251211 15:02:16.146427  7411 raft_consensus.cc:359] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.146538  7411 raft_consensus.cc:385] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:16.146566  7411 raft_consensus.cc:740] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15d3ba15ab3a4c39a408d52a832e734f, State: Initialized, Role: FOLLOWER
I20251211 15:02:16.146697  7411 consensus_queue.cc:260] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.146950  7411 ts_tablet_manager.cc:1434] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20251211 15:02:16.148176  7434 ts_tablet_manager.cc:1916] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:16.148367  7436 ts_tablet_manager.cc:1916] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:16.148722  7421 raft_consensus.cc:493] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:02:16.148823  7421 raft_consensus.cc:515] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.149185  7421 leader_election.cc:290] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25e73e07180c4bb58042a9f262b3bd13 (127.5.160.130:34781), 15d3ba15ab3a4c39a408d52a832e734f (127.5.160.131:37067)
I20251211 15:02:16.149533  7199 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d757611f6eb94bd789709bd8a4cba4bc" candidate_uuid: "27401325960b4ae89950fc13aed5d31c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25e73e07180c4bb58042a9f262b3bd13" is_pre_election: true
I20251211 15:02:16.149564  7341 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d757611f6eb94bd789709bd8a4cba4bc" candidate_uuid: "27401325960b4ae89950fc13aed5d31c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15d3ba15ab3a4c39a408d52a832e734f" is_pre_election: true
I20251211 15:02:16.149680  7341 raft_consensus.cc:2468] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27401325960b4ae89950fc13aed5d31c in term 0.
W20251211 15:02:16.150087  6991 leader_election.cc:343] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25e73e07180c4bb58042a9f262b3bd13 (127.5.160.130:34781): Illegal state: must be running to vote when last-logged opid is not known
I20251211 15:02:16.150238  6991 leader_election.cc:304] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15d3ba15ab3a4c39a408d52a832e734f, 27401325960b4ae89950fc13aed5d31c; no voters: 25e73e07180c4bb58042a9f262b3bd13
I20251211 15:02:16.151427  7421 raft_consensus.cc:2804] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:02:16.151495  7421 raft_consensus.cc:493] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:02:16.151535  7421 raft_consensus.cc:3060] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:16.152376  7436 ts_tablet_manager.cc:1929] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:02:16.152472  7436 log.cc:1199] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/wal/wals/126c3a06b1544ac6add9f1da6adeb497
I20251211 15:02:16.152421  7421 raft_consensus.cc:515] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.152765  7436 ts_tablet_manager.cc:1950] T 126c3a06b1544ac6add9f1da6adeb497 P 27401325960b4ae89950fc13aed5d31c: Deleting consensus metadata
I20251211 15:02:16.152815  7421 leader_election.cc:290] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [CANDIDATE]: Term 1 election: Requested vote from peers 25e73e07180c4bb58042a9f262b3bd13 (127.5.160.130:34781), 15d3ba15ab3a4c39a408d52a832e734f (127.5.160.131:37067)
I20251211 15:02:16.153187  7199 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d757611f6eb94bd789709bd8a4cba4bc" candidate_uuid: "27401325960b4ae89950fc13aed5d31c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25e73e07180c4bb58042a9f262b3bd13"
I20251211 15:02:16.153245  7341 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d757611f6eb94bd789709bd8a4cba4bc" candidate_uuid: "27401325960b4ae89950fc13aed5d31c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15d3ba15ab3a4c39a408d52a832e734f"
I20251211 15:02:16.153364  7341 raft_consensus.cc:3060] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f [term 0 FOLLOWER]: Advancing to term 1
W20251211 15:02:16.153728  6991 leader_election.cc:343] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25e73e07180c4bb58042a9f262b3bd13 (127.5.160.130:34781): Illegal state: must be running to vote when last-logged opid is not known
I20251211 15:02:16.154435  7341 raft_consensus.cc:2468] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27401325960b4ae89950fc13aed5d31c in term 1.
I20251211 15:02:16.154702  6991 leader_election.cc:304] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15d3ba15ab3a4c39a408d52a832e734f, 27401325960b4ae89950fc13aed5d31c; no voters: 25e73e07180c4bb58042a9f262b3bd13
I20251211 15:02:16.154917  7421 raft_consensus.cc:2804] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:16.155021  7421 raft_consensus.cc:697] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [term 1 LEADER]: Becoming Leader. State: Replica: 27401325960b4ae89950fc13aed5d31c, State: Running, Role: LEADER
I20251211 15:02:16.155141  7421 consensus_queue.cc:237] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.156876  6883 catalog_manager.cc:4985] TS 27401325960b4ae89950fc13aed5d31c (127.5.160.129:34991): tablet 126c3a06b1544ac6add9f1da6adeb497 (table test-table [id=2193b0cf504948b181c6f52e17b5e46d]) successfully deleted
I20251211 15:02:16.159825  6898 catalog_manager.cc:5654] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c reported cstate change: term changed from 0 to 1, leader changed from <none> to 27401325960b4ae89950fc13aed5d31c (127.5.160.129). New cstate: current_term: 1 leader_uuid: "27401325960b4ae89950fc13aed5d31c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } health_report { overall_health: UNKNOWN } } }
I20251211 15:02:16.154033  7435 ts_tablet_manager.cc:1929] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:02:16.167090  7435 log.cc:1199] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/wal/wals/126c3a06b1544ac6add9f1da6adeb497
I20251211 15:02:16.167409  7435 ts_tablet_manager.cc:1950] T 126c3a06b1544ac6add9f1da6adeb497 P 25e73e07180c4bb58042a9f262b3bd13: Deleting consensus metadata
I20251211 15:02:16.168766  6885 catalog_manager.cc:4985] TS 25e73e07180c4bb58042a9f262b3bd13 (127.5.160.130:34781): tablet 126c3a06b1544ac6add9f1da6adeb497 (table test-table [id=2193b0cf504948b181c6f52e17b5e46d]) successfully deleted
I20251211 15:02:16.169561  7434 ts_tablet_manager.cc:1929] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:02:16.169663  7434 log.cc:1199] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/wal/wals/126c3a06b1544ac6add9f1da6adeb497
I20251211 15:02:16.169972  7434 ts_tablet_manager.cc:1950] T 126c3a06b1544ac6add9f1da6adeb497 P 15d3ba15ab3a4c39a408d52a832e734f: Deleting consensus metadata
I20251211 15:02:16.171239  6885 catalog_manager.cc:4985] TS 15d3ba15ab3a4c39a408d52a832e734f (127.5.160.131:37067): tablet 126c3a06b1544ac6add9f1da6adeb497 (table test-table [id=2193b0cf504948b181c6f52e17b5e46d]) successfully deleted
I20251211 15:02:16.171962  7414 tablet_bootstrap.cc:492] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13: No bootstrap required, opened a new log
I20251211 15:02:16.172060  7414 ts_tablet_manager.cc:1403] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13: Time spent bootstrapping tablet: real 0.031s	user 0.002s	sys 0.000s
I20251211 15:02:16.172716  7414 raft_consensus.cc:359] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.172852  7414 raft_consensus.cc:385] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:16.172892  7414 raft_consensus.cc:740] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25e73e07180c4bb58042a9f262b3bd13, State: Initialized, Role: FOLLOWER
I20251211 15:02:16.173032  7414 consensus_queue.cc:260] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.173313  7414 ts_tablet_manager.cc:1434] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
W20251211 15:02:16.188331  7246 tablet.cc:2378] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251211 15:02:16.192544  7388 tablet.cc:2378] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f: Can't schedule compaction. Clean time has not been advanced past its initial value.
Dec 11 15:02:16 dist-test-slave-4k3m krb5kdc[6850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465335, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:16.201174  6947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:16.192896 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40600 (local address 127.5.160.190:44001)
1211 15:02:16.193078 (+   182us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:16.193082 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:16.193188 (+   106us) server_negotiation.cc:408] Connection header received
1211 15:02:16.193317 (+   129us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:16.193320 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:16.193377 (+    57us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:16.193472 (+    95us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:16.194250 (+   778us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.195081 (+   831us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.195720 (+   639us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.195916 (+   196us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.198023 (+  2107us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:16.198041 (+    18us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:16.198044 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:16.198067 (+    23us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:16.199466 (+  1399us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:16.200017 (+   551us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:16.200020 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:16.200021 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:16.200064 (+    43us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:16.200281 (+   217us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:16.200283 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:16.200285 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:16.200432 (+   147us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:16.200536 (+   104us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:16.200838 (+   302us) server_negotiation.cc:300] Negotiation successful
1211 15:02:16.201024 (+   186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":128}
I20251211 15:02:16.201181  7446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:16.192754 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44001 (local address 127.0.0.1:40600)
1211 15:02:16.193079 (+   325us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:16.193095 (+    16us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:16.193224 (+   129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:16.193519 (+   295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:16.193521 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:16.193941 (+   420us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:16.194136 (+   195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:16.194142 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.195216 (+  1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.195219 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:16.195618 (+   399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:16.195625 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.195727 (+   102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.196279 (+   552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:16.196292 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:16.197883 (+  1591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:16.199584 (+  1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:16.199593 (+     9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:16.199600 (+     7us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:16.199910 (+   310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:16.200143 (+   233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:16.200146 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:16.200148 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:16.200207 (+    59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:16.200520 (+   313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:16.200529 (+     9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:16.200660 (+   131us) client_negotiation.cc:769] Sending connection context
1211 15:02:16.200783 (+   123us) client_negotiation.cc:240] Negotiation successful
1211 15:02:16.200949 (+   166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":106,"threads_started":1}
I20251211 15:02:16.205421  6898 catalog_manager.cc:2257] Servicing CreateTable request from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:40600:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20251211 15:02:16.205560  7104 tablet.cc:2378] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251211 15:02:16.206254  6898 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:02:16.211513  7037 tablet_service.cc:1505] Processing CreateTablet for tablet ba55f33e1fd049739e965c8ae7b8b4fb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=adfa9badf7a54cf09f002511c4539eb4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20251211 15:02:16.211942  7037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba55f33e1fd049739e965c8ae7b8b4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:16.211889  7321 tablet_service.cc:1505] Processing CreateTablet for tablet ba55f33e1fd049739e965c8ae7b8b4fb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=adfa9badf7a54cf09f002511c4539eb4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20251211 15:02:16.212219  7321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba55f33e1fd049739e965c8ae7b8b4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:16.214219  7410 tablet_bootstrap.cc:492] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c: Bootstrap starting.
I20251211 15:02:16.214807  7411 tablet_bootstrap.cc:492] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f: Bootstrap starting.
I20251211 15:02:16.215150  7410 tablet_bootstrap.cc:654] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:16.215792  7411 tablet_bootstrap.cc:654] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:16.216020  7179 tablet_service.cc:1505] Processing CreateTablet for tablet ba55f33e1fd049739e965c8ae7b8b4fb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=adfa9badf7a54cf09f002511c4539eb4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20251211 15:02:16.216382  7179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba55f33e1fd049739e965c8ae7b8b4fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:16.216991  7411 tablet_bootstrap.cc:492] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f: No bootstrap required, opened a new log
I20251211 15:02:16.217065  7411 ts_tablet_manager.cc:1403] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:02:16.217535  7411 raft_consensus.cc:359] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.217638  7411 raft_consensus.cc:385] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:16.217666  7411 raft_consensus.cc:740] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15d3ba15ab3a4c39a408d52a832e734f, State: Initialized, Role: FOLLOWER
I20251211 15:02:16.217801  7411 consensus_queue.cc:260] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.218051  7411 ts_tablet_manager.cc:1434] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20251211 15:02:16.218056  7417 tablet_replica.cc:442] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } }
I20251211 15:02:16.218291  7417 tablet_replica.cc:445] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:02:16.218828  7414 tablet_bootstrap.cc:492] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13: Bootstrap starting.
I20251211 15:02:16.219801  7414 tablet_bootstrap.cc:654] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:16.219908  7410 tablet_bootstrap.cc:492] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c: No bootstrap required, opened a new log
I20251211 15:02:16.220009  7410 ts_tablet_manager.cc:1403] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c: Time spent bootstrapping tablet: real 0.006s	user 0.000s	sys 0.001s
I20251211 15:02:16.220680  7410 raft_consensus.cc:359] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.220798  7410 raft_consensus.cc:385] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:16.220841  7410 raft_consensus.cc:740] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27401325960b4ae89950fc13aed5d31c, State: Initialized, Role: FOLLOWER
I20251211 15:02:16.220971  7410 consensus_queue.cc:260] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.221856  7430 tablet_replica.cc:442] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } }
I20251211 15:02:16.221969  7430 tablet_replica.cc:445] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:02:16.222198  7414 tablet_bootstrap.cc:492] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13: No bootstrap required, opened a new log
I20251211 15:02:16.222283  7414 ts_tablet_manager.cc:1403] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20251211 15:02:16.222373  7410 ts_tablet_manager.cc:1434] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:02:16.222697  7414 raft_consensus.cc:359] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.222786  7414 raft_consensus.cc:385] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:16.222806  7414 raft_consensus.cc:740] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25e73e07180c4bb58042a9f262b3bd13, State: Initialized, Role: FOLLOWER
I20251211 15:02:16.222921  7414 consensus_queue.cc:260] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.223170  7414 ts_tablet_manager.cc:1434] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20251211 15:02:16.223882  7418 tablet_replica.cc:442] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } }
I20251211 15:02:16.224000  7418 tablet_replica.cc:445] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:02:16.279228  7430 raft_consensus.cc:493] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:02:16.279367  7430 raft_consensus.cc:515] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.279812  7430 leader_election.cc:290] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25e73e07180c4bb58042a9f262b3bd13 (127.5.160.130:34781), 15d3ba15ab3a4c39a408d52a832e734f (127.5.160.131:37067)
I20251211 15:02:16.280330  7341 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba55f33e1fd049739e965c8ae7b8b4fb" candidate_uuid: "27401325960b4ae89950fc13aed5d31c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15d3ba15ab3a4c39a408d52a832e734f" is_pre_election: true
I20251211 15:02:16.280341  7199 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba55f33e1fd049739e965c8ae7b8b4fb" candidate_uuid: "27401325960b4ae89950fc13aed5d31c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25e73e07180c4bb58042a9f262b3bd13" is_pre_election: true
I20251211 15:02:16.280476  7341 raft_consensus.cc:2468] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27401325960b4ae89950fc13aed5d31c in term 0.
I20251211 15:02:16.280516  7199 raft_consensus.cc:2468] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27401325960b4ae89950fc13aed5d31c in term 0.
I20251211 15:02:16.280885  6991 leader_election.cc:304] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25e73e07180c4bb58042a9f262b3bd13, 27401325960b4ae89950fc13aed5d31c; no voters: 
I20251211 15:02:16.281155  7430 raft_consensus.cc:2804] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:02:16.281204  7430 raft_consensus.cc:493] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:02:16.281240  7430 raft_consensus.cc:3060] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:16.282459  7430 raft_consensus.cc:515] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.282809  7430 leader_election.cc:290] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [CANDIDATE]: Term 1 election: Requested vote from peers 25e73e07180c4bb58042a9f262b3bd13 (127.5.160.130:34781), 15d3ba15ab3a4c39a408d52a832e734f (127.5.160.131:37067)
I20251211 15:02:16.283258  7199 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba55f33e1fd049739e965c8ae7b8b4fb" candidate_uuid: "27401325960b4ae89950fc13aed5d31c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25e73e07180c4bb58042a9f262b3bd13"
I20251211 15:02:16.283340  7341 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ba55f33e1fd049739e965c8ae7b8b4fb" candidate_uuid: "27401325960b4ae89950fc13aed5d31c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15d3ba15ab3a4c39a408d52a832e734f"
I20251211 15:02:16.283399  7199 raft_consensus.cc:3060] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:16.283461  7341 raft_consensus.cc:3060] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:16.284262  7341 raft_consensus.cc:2468] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27401325960b4ae89950fc13aed5d31c in term 1.
I20251211 15:02:16.284535  7199 raft_consensus.cc:2468] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27401325960b4ae89950fc13aed5d31c in term 1.
I20251211 15:02:16.284533  6991 leader_election.cc:304] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15d3ba15ab3a4c39a408d52a832e734f, 27401325960b4ae89950fc13aed5d31c; no voters: 
I20251211 15:02:16.284716  7430 raft_consensus.cc:2804] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:16.284802  7430 raft_consensus.cc:697] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [term 1 LEADER]: Becoming Leader. State: Replica: 27401325960b4ae89950fc13aed5d31c, State: Running, Role: LEADER
I20251211 15:02:16.284932  7430 consensus_queue.cc:237] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } }
I20251211 15:02:16.285665  7421 tablet_replica.cc:442] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c: TxnStatusTablet state changed. Reason: New leader 27401325960b4ae89950fc13aed5d31c. Latest consensus state: current_term: 1 leader_uuid: "27401325960b4ae89950fc13aed5d31c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } }
I20251211 15:02:16.285806  7421 tablet_replica.cc:445] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c: This TxnStatusTablet replica's current role is: LEADER
I20251211 15:02:16.286094  7451 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20251211 15:02:16.286229  7451 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20251211 15:02:16.286844  6898 catalog_manager.cc:5654] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c reported cstate change: term changed from 0 to 1, leader changed from <none> to 27401325960b4ae89950fc13aed5d31c (127.5.160.129). New cstate: current_term: 1 leader_uuid: "27401325960b4ae89950fc13aed5d31c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } health_report { overall_health: UNKNOWN } } }
I20251211 15:02:16.299856  7406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:16.296949 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38784 (local address 127.5.160.129:34991)
1211 15:02:16.297062 (+   113us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:16.297066 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:16.297159 (+    93us) server_negotiation.cc:408] Connection header received
1211 15:02:16.297320 (+   161us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:16.297323 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:16.297371 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:16.297436 (+    65us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:02:16.297818 (+   382us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.298320 (+   502us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.299206 (+   886us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.299360 (+   154us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.299400 (+    40us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:02:16.299474 (+    74us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:02:16.299573 (+    99us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:16.299698 (+   125us) server_negotiation.cc:300] Negotiation successful
1211 15:02:16.299745 (+    47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20251211 15:02:16.299911  7446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:16.296866 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:34991 (local address 127.0.0.1:38784)
1211 15:02:16.297095 (+   229us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:16.297109 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:16.297226 (+   117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:16.297458 (+   232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:16.297461 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:16.297469 (+     8us) client_negotiation.cc:189] Negotiated authn=TOKEN
1211 15:02:16.297719 (+   250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:16.297725 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.298415 (+   690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.298419 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:16.299091 (+   672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:16.299102 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.299215 (+   113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.299264 (+    49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
1211 15:02:16.299599 (+   335us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
1211 15:02:16.299615 (+    16us) client_negotiation.cc:769] Sending connection context
1211 15:02:16.299681 (+    66us) client_negotiation.cc:240] Negotiation successful
1211 15:02:16.299762 (+    81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131}
I20251211 15:02:16.302610  7341 raft_consensus.cc:1275] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f [term 1 FOLLOWER]: Refusing update from remote peer 27401325960b4ae89950fc13aed5d31c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:16.302757  7199 raft_consensus.cc:1275] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13 [term 1 FOLLOWER]: Refusing update from remote peer 27401325960b4ae89950fc13aed5d31c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:16.303099  7421 consensus_queue.cc:1048] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [LEADER]: Connected to new peer: Peer: permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:16.303241  7430 consensus_queue.cc:1048] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c [LEADER]: Connected to new peer: Peer: permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:16.305410  7418 tablet_replica.cc:442] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13: TxnStatusTablet state changed. Reason: New leader 27401325960b4ae89950fc13aed5d31c. Latest consensus state: current_term: 1 leader_uuid: "27401325960b4ae89950fc13aed5d31c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } }
I20251211 15:02:16.305541  7418 tablet_replica.cc:445] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:02:16.305766  7430 tablet_replica.cc:442] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "27401325960b4ae89950fc13aed5d31c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } }
I20251211 15:02:16.305881  7430 tablet_replica.cc:445] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c: This TxnStatusTablet replica's current role is: LEADER
I20251211 15:02:16.307286  7417 tablet_replica.cc:442] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f: TxnStatusTablet state changed. Reason: New leader 27401325960b4ae89950fc13aed5d31c. Latest consensus state: current_term: 1 leader_uuid: "27401325960b4ae89950fc13aed5d31c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } }
I20251211 15:02:16.307399  7417 tablet_replica.cc:445] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:02:16.307852  7426 mvcc.cc:204] Tried to move back new op lower bound from 7231346017491230720 to 7231346017424519168. Current Snapshot: MvccSnapshot[applied={T|T < 7231346017491230720 or (T in {7231346017491230720})}]
I20251211 15:02:16.308048  7418 tablet_replica.cc:442] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "27401325960b4ae89950fc13aed5d31c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } }
I20251211 15:02:16.308131  7418 tablet_replica.cc:445] T ba55f33e1fd049739e965c8ae7b8b4fb P 25e73e07180c4bb58042a9f262b3bd13: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:02:16.312309  7430 tablet_replica.cc:442] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "27401325960b4ae89950fc13aed5d31c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } }
I20251211 15:02:16.312449  7430 tablet_replica.cc:445] T ba55f33e1fd049739e965c8ae7b8b4fb P 27401325960b4ae89950fc13aed5d31c: This TxnStatusTablet replica's current role is: LEADER
I20251211 15:02:16.313059  7417 tablet_replica.cc:442] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "27401325960b4ae89950fc13aed5d31c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27401325960b4ae89950fc13aed5d31c" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34991 } } peers { permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 } } peers { permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 } } }
I20251211 15:02:16.313167  7417 tablet_replica.cc:445] T ba55f33e1fd049739e965c8ae7b8b4fb P 15d3ba15ab3a4c39a408d52a832e734f: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:02:16.321089  7457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:16.318119 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:34991 (local address 127.5.160.129:43401)
1211 15:02:16.318355 (+   236us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:16.318368 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:16.318457 (+    89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:16.318668 (+   211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:16.318671 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:16.318677 (+     6us) client_negotiation.cc:189] Negotiated authn=TOKEN
1211 15:02:16.318890 (+   213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:16.318895 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.319904 (+  1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.319906 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:16.320313 (+   407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:16.320319 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.320407 (+    88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.320445 (+    38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
1211 15:02:16.320828 (+   383us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
1211 15:02:16.320832 (+     4us) client_negotiation.cc:769] Sending connection context
1211 15:02:16.320886 (+    54us) client_negotiation.cc:240] Negotiation successful
1211 15:02:16.320945 (+    59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":85,"threads_started":1}
I20251211 15:02:16.321108  7406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:16.318173 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:43401 (local address 127.5.160.129:34991)
1211 15:02:16.318285 (+   112us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:16.318289 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:16.318424 (+   135us) server_negotiation.cc:408] Connection header received
1211 15:02:16.318532 (+   108us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:16.318535 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:16.318584 (+    49us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:16.318652 (+    68us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:02:16.319043 (+   391us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.319802 (+   759us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.320412 (+   610us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.320589 (+   177us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.320654 (+    65us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:02:16.320748 (+    94us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:02:16.320822 (+    74us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:16.320929 (+   107us) server_negotiation.cc:300] Negotiation successful
1211 15:02:16.320974 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20251211 15:02:16.327100  7199 raft_consensus.cc:3060] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:16.327201  7341 raft_consensus.cc:1275] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f [term 1 FOLLOWER]: Refusing update from remote peer 27401325960b4ae89950fc13aed5d31c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:16.327601  7430 consensus_queue.cc:1048] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [LEADER]: Connected to new peer: Peer: permanent_uuid: "15d3ba15ab3a4c39a408d52a832e734f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:16.328425  7199 raft_consensus.cc:1275] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13 [term 1 FOLLOWER]: Refusing update from remote peer 27401325960b4ae89950fc13aed5d31c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:16.329447  7430 consensus_queue.cc:1048] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [LEADER]: Connected to new peer: Peer: permanent_uuid: "25e73e07180c4bb58042a9f262b3bd13" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 34781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:16.364419  6898 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40588:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:16.364595  6898 catalog_manager.cc:2755] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40588:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:16.366691  6898 catalog_manager.cc:5941] T 00000000000000000000000000000000 P deb0fab8ed7c4052a2dd0266c2b99be2: Sending DeleteTablet for 3 replicas of tablet d757611f6eb94bd789709bd8a4cba4bc
I20251211 15:02:16.367445  7321 tablet_service.cc:1552] Processing DeleteTablet for tablet d757611f6eb94bd789709bd8a4cba4bc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:16 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:60842
I20251211 15:02:16.367604  7179 tablet_service.cc:1552] Processing DeleteTablet for tablet d757611f6eb94bd789709bd8a4cba4bc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:16 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:59946
I20251211 15:02:16.367794  7435 tablet_replica.cc:333] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13: stopping tablet replica
I20251211 15:02:16.367903  7435 raft_consensus.cc:2243] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:02:16.367944  7037 tablet_service.cc:1552] Processing DeleteTablet for tablet d757611f6eb94bd789709bd8a4cba4bc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:16 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:38770
I20251211 15:02:16.368076  7435 raft_consensus.cc:2272] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:16.368101  7436 tablet_replica.cc:333] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c: stopping tablet replica
I20251211 15:02:16.368191  7436 raft_consensus.cc:2243] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [term 1 LEADER]: Raft consensus shutting down.
I20251211 15:02:16.368317  7434 tablet_replica.cc:333] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f: stopping tablet replica
I20251211 15:02:16.368353  7436 raft_consensus.cc:2272] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:16.368432  7434 raft_consensus.cc:2243] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:02:16.368533  7434 raft_consensus.cc:2272] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:16.368868  7435 ts_tablet_manager.cc:1916] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:16.369191  7436 ts_tablet_manager.cc:1916] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:16.369252  7434 ts_tablet_manager.cc:1916] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:16.371676  7436 ts_tablet_manager.cc:1929] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20251211 15:02:16.371709  7435 ts_tablet_manager.cc:1929] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20251211 15:02:16.371748  7436 log.cc:1199] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-0/wal/wals/d757611f6eb94bd789709bd8a4cba4bc
I20251211 15:02:16.371775  7435 log.cc:1199] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-1/wal/wals/d757611f6eb94bd789709bd8a4cba4bc
I20251211 15:02:16.371877  7434 ts_tablet_manager.cc:1929] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20251211 15:02:16.371942  7434 log.cc:1199] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1765465326787564-5762-0/minicluster-data/ts-2/wal/wals/d757611f6eb94bd789709bd8a4cba4bc
I20251211 15:02:16.371986  7436 ts_tablet_manager.cc:1950] T d757611f6eb94bd789709bd8a4cba4bc P 27401325960b4ae89950fc13aed5d31c: Deleting consensus metadata
I20251211 15:02:16.371991  7435 ts_tablet_manager.cc:1950] T d757611f6eb94bd789709bd8a4cba4bc P 25e73e07180c4bb58042a9f262b3bd13: Deleting consensus metadata
I20251211 15:02:16.372201  7434 ts_tablet_manager.cc:1950] T d757611f6eb94bd789709bd8a4cba4bc P 15d3ba15ab3a4c39a408d52a832e734f: Deleting consensus metadata
I20251211 15:02:16.372726  6883 catalog_manager.cc:4985] TS 27401325960b4ae89950fc13aed5d31c (127.5.160.129:34991): tablet d757611f6eb94bd789709bd8a4cba4bc (table test-table [id=64c5832de41644ea8e49381462422f8b]) successfully deleted
I20251211 15:02:16.372841  6885 catalog_manager.cc:4985] TS 15d3ba15ab3a4c39a408d52a832e734f (127.5.160.131:37067): tablet d757611f6eb94bd789709bd8a4cba4bc (table test-table [id=64c5832de41644ea8e49381462422f8b]) successfully deleted
I20251211 15:02:16.373301  6885 catalog_manager.cc:4985] TS 25e73e07180c4bb58042a9f262b3bd13 (127.5.160.130:34781): tablet d757611f6eb94bd789709bd8a4cba4bc (table test-table [id=64c5832de41644ea8e49381462422f8b]) successfully deleted
Dec 11 15:02:16 dist-test-slave-4k3m krb5kdc[6850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465335, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.160.129@KRBTEST.COM
I20251211 15:02:16.381894  7406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:16.373127 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38794 (local address 127.5.160.129:34991)
1211 15:02:16.373238 (+   111us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:16.373243 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:16.373706 (+   463us) server_negotiation.cc:408] Connection header received
1211 15:02:16.373824 (+   118us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:16.373827 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:16.373875 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:16.374069 (+   194us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:16.374790 (+   721us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.375320 (+   530us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.375968 (+   648us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.376142 (+   174us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.378568 (+  2426us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:16.378594 (+    26us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:16.378607 (+    13us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:16.378634 (+    27us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:16.380334 (+  1700us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:16.380805 (+   471us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:16.380810 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:16.380811 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:16.380865 (+    54us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:16.381074 (+   209us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:16.381077 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:16.381078 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:16.381269 (+   191us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:16.381417 (+   148us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:16.381620 (+   203us) server_negotiation.cc:300] Negotiation successful
1211 15:02:16.381743 (+   123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
W20251211 15:02:16.382493  7096 server_base.cc:1129] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38794
I20251211 15:02:16.390981  6947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:16.384177 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40610 (local address 127.5.160.190:44001)
1211 15:02:16.384312 (+   135us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:16.384316 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:16.384331 (+    15us) server_negotiation.cc:408] Connection header received
1211 15:02:16.384401 (+    70us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:16.384405 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:16.384452 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:16.384531 (+    79us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:16.385198 (+   667us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.385980 (+   782us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:16.386615 (+   635us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:16.386806 (+   191us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:16.387784 (+   978us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:16.387805 (+    21us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:16.387808 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:16.387838 (+    30us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:16.389419 (+  1581us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:16.389872 (+   453us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:16.389876 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:16.389878 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:16.389932 (+    54us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:16.390123 (+   191us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:16.390126 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:16.390129 (+     3us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:16.390323 (+   194us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:16.390449 (+   126us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:16.390636 (+   187us) server_negotiation.cc:300] Negotiation successful
1211 15:02:16.390761 (+   125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20251211 15:02:16.391366  6898 server_base.cc:1129] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40610
I20251211 15:02:16.392657  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 6972
I20251211 15:02:16.399603  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 7114
I20251211 15:02:16.404731  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 7256
I20251211 15:02:16.409904  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 6866
2025-12-11T15:02:16Z chronyd exiting
[       OK ] SecurityITest.SmokeTestAsAuthorizedUser (3404 ms)
[ RUN      ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:02:16 dist-test-slave-4k3m krb5kdc[7467](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:02:16 dist-test-slave-4k3m krb5kdc[7467](info): set up 2 sockets
Dec 11 15:02:16 dist-test-slave-4k3m krb5kdc[7467](info): commencing operation
krb5kdc: starting...
W20251211 15:02:18.251284  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.819s	user 0.004s	sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:02:18 dist-test-slave-4k3m krb5kdc[7467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:02:18Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:02:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:18.388209  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:32791
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:45957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:32791
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:18.495957  7483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:18.496222  7483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:18.496280  7483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:18.499714  7483 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:02:18.499787  7483 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20251211 15:02:18.499804  7483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:18.499825  7483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:18.499842  7483 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:02:18.499866  7483 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:02:18.504649  7483 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:45957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:32791
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:32791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:18.505789  7483 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:18.506631  7483 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:18.512466  7491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:18.512502  7489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:18.512598  7488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:18.512800  7483 server_base.cc:1047] running on GCE node
I20251211 15:02:18.513288  7483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:18.514218  7483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:18.515364  7483 hybrid_clock.cc:648] HybridClock initialized: now 1765465338515340 us; error 42 us; skew 500 ppm
Dec 11 15:02:18 dist-test-slave-4k3m krb5kdc[7467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465338, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:18.517935  7483 init.cc:377] Logged in from keytab as kudu/127.5.160.190@KRBTEST.COM (short username kudu)
I20251211 15:02:18.519068  7483 webserver.cc:492] Webserver started at http://127.5.160.190:37643/ using document root <none> and password file <none>
I20251211 15:02:18.519626  7483 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:18.519678  7483 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:18.519858  7483 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:18.521562  7483 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "c2a68018d5714725b8860f727fbb0273"
format_stamp: "Formatted at 2025-12-11 15:02:18 on dist-test-slave-4k3m"
server_key: "38ee06ffaecf04d64c1ef5c9821cba4b"
server_key_iv: "d6874cb16a2031e8fbeca56812af645b"
server_key_version: "encryptionkey@0"
I20251211 15:02:18.522029  7483 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "c2a68018d5714725b8860f727fbb0273"
format_stamp: "Formatted at 2025-12-11 15:02:18 on dist-test-slave-4k3m"
server_key: "38ee06ffaecf04d64c1ef5c9821cba4b"
server_key_iv: "d6874cb16a2031e8fbeca56812af645b"
server_key_version: "encryptionkey@0"
I20251211 15:02:18.525456  7483 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.006s
I20251211 15:02:18.527880  7498 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:18.529028  7483 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20251211 15:02:18.529142  7483 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "c2a68018d5714725b8860f727fbb0273"
format_stamp: "Formatted at 2025-12-11 15:02:18 on dist-test-slave-4k3m"
server_key: "38ee06ffaecf04d64c1ef5c9821cba4b"
server_key_iv: "d6874cb16a2031e8fbeca56812af645b"
server_key_version: "encryptionkey@0"
I20251211 15:02:18.529235  7483 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:18.544039  7483 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:18.549793  7483 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:18.549980  7483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:18.557881  7483 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:32791
I20251211 15:02:18.557899  7560 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:32791 every 8 connection(s)
I20251211 15:02:18.558918  7483 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:02:18.562103  7561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:18.564116  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 7483
I20251211 15:02:18.564239  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:02:18.564498  5762 external_mini_cluster.cc:1468] Setting key 12c42cd584e52efc6634dfe3a8369061
I20251211 15:02:18.567929  7561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273: Bootstrap starting.
I20251211 15:02:18.570041  7561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:18.570875  7561 log.cc:826] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273: Log is configured to *not* fsync() on all Append() calls
Dec 11 15:02:18 dist-test-slave-4k3m krb5kdc[7467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:18.572954  7561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273: No bootstrap required, opened a new log
I20251211 15:02:18.576747  7561 raft_consensus.cc:359] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a68018d5714725b8860f727fbb0273" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 32791 } }
I20251211 15:02:18.576972  7561 raft_consensus.cc:385] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:18.577028  7561 raft_consensus.cc:740] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2a68018d5714725b8860f727fbb0273, State: Initialized, Role: FOLLOWER
I20251211 15:02:18.577410  7564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:18.565799 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59554 (local address 127.5.160.190:32791)
1211 15:02:18.566226 (+   427us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:18.566237 (+    11us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:18.566272 (+    35us) server_negotiation.cc:408] Connection header received
1211 15:02:18.567024 (+   752us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:18.567046 (+    22us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:18.567357 (+   311us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:18.567667 (+   310us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:18.568559 (+   892us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:18.569302 (+   743us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:18.569961 (+   659us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:18.570229 (+   268us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:18.572664 (+  2435us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:18.572683 (+    19us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:18.572695 (+    12us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:18.572727 (+    32us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:18.574670 (+  1943us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:18.575156 (+   486us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:18.575163 (+     7us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:18.575168 (+     5us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:18.575264 (+    96us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:18.575459 (+   195us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:18.575463 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:18.575465 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:18.575955 (+   490us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:18.576161 (+   206us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:18.576355 (+   194us) server_negotiation.cc:300] Negotiation successful
1211 15:02:18.576632 (+   277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":141,"threads_started":1}
I20251211 15:02:18.577493  7561 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a68018d5714725b8860f727fbb0273" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 32791 } }
I20251211 15:02:18.577636  7561 raft_consensus.cc:399] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:02:18.577700  7561 raft_consensus.cc:493] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:02:18.577785  7561 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:18.578805  7561 raft_consensus.cc:515] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a68018d5714725b8860f727fbb0273" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 32791 } }
I20251211 15:02:18.579182  7561 leader_election.cc:304] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2a68018d5714725b8860f727fbb0273; no voters: 
I20251211 15:02:18.579474  7561 leader_election.cc:290] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:02:18.579552  7566 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:18.579706  7566 raft_consensus.cc:697] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [term 1 LEADER]: Becoming Leader. State: Replica: c2a68018d5714725b8860f727fbb0273, State: Running, Role: LEADER
I20251211 15:02:18.579990  7566 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a68018d5714725b8860f727fbb0273" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 32791 } }
I20251211 15:02:18.580632  7561 sys_catalog.cc:565] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:02:18.581651  7568 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2a68018d5714725b8860f727fbb0273" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a68018d5714725b8860f727fbb0273" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 32791 } } }
I20251211 15:02:18.581665  7567 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2a68018d5714725b8860f727fbb0273. Latest consensus state: current_term: 1 leader_uuid: "c2a68018d5714725b8860f727fbb0273" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a68018d5714725b8860f727fbb0273" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 32791 } } }
I20251211 15:02:18.581789  7568 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:18.581787  7567 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:18.582159  7575 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:02:18.585273  7575 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:02:18.590732  7575 catalog_manager.cc:1357] Generated new cluster ID: 28fbe1996955480ab4dc2f020146f69a
I20251211 15:02:18.590817  7575 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:02:18.603911  7575 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:02:18.604984  7575 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:02:18.613106  7575 catalog_manager.cc:6027] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273: Generated new TSK 0
I20251211 15:02:18.614048  7575 catalog_manager.cc:1524] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:18.670660  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:32791
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:45957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:18.782296  7589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:18.782559  7589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:18.782630  7589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:18.786051  7589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:18.786130  7589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:18.786185  7589 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20251211 15:02:18.786206  7589 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20251211 15:02:18.786252  7589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:02:18.790623  7589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:45957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--webserver_require_spnego=true
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.160.190:32791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:18.791769  7589 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:18.792601  7589 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:18.799223  7594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:18.799328  7595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:18.799453  7589 server_base.cc:1047] running on GCE node
W20251211 15:02:18.799566  7597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:18.799907  7589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:18.800478  7589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:18.801626  7589 hybrid_clock.cc:648] HybridClock initialized: now 1765465338801609 us; error 37 us; skew 500 ppm
Dec 11 15:02:18 dist-test-slave-4k3m krb5kdc[7467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465338, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:18.804275  7589 init.cc:377] Logged in from keytab as kudu/127.5.160.129@KRBTEST.COM (short username kudu)
I20251211 15:02:18.805354  7589 webserver.cc:492] Webserver started at http://127.5.160.129:42257/ using document root <none> and password file <none>
I20251211 15:02:18.805917  7589 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:18.805971  7589 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:18.806180  7589 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:18.808012  7589 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "61542c6f98af45d08f8b11a9c6a6fb28"
format_stamp: "Formatted at 2025-12-11 15:02:18 on dist-test-slave-4k3m"
server_key: "b9689023edd3ad47d67fa3f854c5ad3c"
server_key_iv: "df191dcec16830ea7688067e3930b04c"
server_key_version: "encryptionkey@0"
I20251211 15:02:18.808487  7589 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "61542c6f98af45d08f8b11a9c6a6fb28"
format_stamp: "Formatted at 2025-12-11 15:02:18 on dist-test-slave-4k3m"
server_key: "b9689023edd3ad47d67fa3f854c5ad3c"
server_key_iv: "df191dcec16830ea7688067e3930b04c"
server_key_version: "encryptionkey@0"
I20251211 15:02:18.812067  7589 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.004s
I20251211 15:02:18.814327  7604 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:18.815387  7589 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20251211 15:02:18.815500  7589 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "61542c6f98af45d08f8b11a9c6a6fb28"
format_stamp: "Formatted at 2025-12-11 15:02:18 on dist-test-slave-4k3m"
server_key: "b9689023edd3ad47d67fa3f854c5ad3c"
server_key_iv: "df191dcec16830ea7688067e3930b04c"
server_key_version: "encryptionkey@0"
I20251211 15:02:18.815591  7589 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:18.830719  7589 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:18.833930  7589 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:18.834120  7589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:18.835705  7589 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:18.835772  7589 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:18.835824  7589 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:18.835847  7589 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
Dec 11 15:02:18 dist-test-slave-4k3m krb5kdc[7467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465338, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:18.846133  7589 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:34441
I20251211 15:02:18.846755  7719 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:34441 every 8 connection(s)
I20251211 15:02:18.847308  7589 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:02:18.847572  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 7589
I20251211 15:02:18.847679  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:02:18.847935  5762 external_mini_cluster.cc:1468] Setting key 9342ba09c7f9876dfc5589d27eef8716
I20251211 15:02:18.848694  7564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:18.836463 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:46035 (local address 127.5.160.190:32791)
1211 15:02:18.836587 (+   124us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:18.836591 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:18.837554 (+   963us) server_negotiation.cc:408] Connection header received
1211 15:02:18.838467 (+   913us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:18.838471 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:18.838533 (+    62us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:18.838606 (+    73us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:18.840386 (+  1780us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:18.841194 (+   808us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:18.842098 (+   904us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:18.842291 (+   193us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:18.844893 (+  2602us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:18.844920 (+    27us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:18.844924 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:18.844959 (+    35us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:18.846554 (+  1595us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:18.847136 (+   582us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:18.847140 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:18.847142 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:18.847198 (+    56us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:18.847538 (+   340us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:18.847541 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:18.847543 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:18.847752 (+   209us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:18.847854 (+   102us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:18.848416 (+   562us) server_negotiation.cc:300] Negotiation successful
1211 15:02:18.848555 (+   139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20251211 15:02:18.849376  7613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:18.836799 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:32791 (local address 127.5.160.129:46035)
1211 15:02:18.837370 (+   571us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:18.837408 (+    38us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:18.838242 (+   834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:18.838805 (+   563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:18.838816 (+    11us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:18.839444 (+   628us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:18.840193 (+   749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:18.840212 (+    19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:18.841337 (+  1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:18.841342 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:18.841977 (+   635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:18.841987 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:18.842218 (+   231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:18.842947 (+   729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:18.842981 (+    34us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:18.844748 (+  1767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:18.846670 (+  1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:18.846686 (+    16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:18.846697 (+    11us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:18.847041 (+   344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:18.847308 (+   267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:18.847312 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:18.847314 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:18.847418 (+   104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:18.847848 (+   430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:18.847853 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:18.848135 (+   282us) client_negotiation.cc:769] Sending connection context
1211 15:02:18.848353 (+   218us) client_negotiation.cc:240] Negotiation successful
1211 15:02:18.848624 (+   271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":143,"threads_started":1}
I20251211 15:02:18.850795  7720 heartbeater.cc:344] Connected to a master server at 127.5.160.190:32791
I20251211 15:02:18.850967  7720 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:18.851539  7720 heartbeater.cc:507] Master 127.5.160.190:32791 requested a full tablet report, sending...
I20251211 15:02:18.852953  7512 ts_manager.cc:194] Registered new tserver with Master: 61542c6f98af45d08f8b11a9c6a6fb28 (127.5.160.129:34441)
I20251211 15:02:18.854386  7512 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:46035
WARNING: no policy specified for kudu/127.5.160.130@KRBTEST.COM; defaulting to no policy
I20251211 15:02:18.859455  7727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:18.852796 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:32791 (local address 127.5.160.129:43841)
1211 15:02:18.853084 (+   288us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:18.853098 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:18.853191 (+    93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:18.853402 (+   211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:18.853404 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:18.853586 (+   182us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:18.853787 (+   201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:18.853793 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:18.854852 (+  1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:18.854856 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:18.855455 (+   599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:18.855465 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:18.855582 (+   117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:18.856117 (+   535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:18.856135 (+    18us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:18.856508 (+   373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:18.858197 (+  1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:18.858200 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:18.858201 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:18.858354 (+   153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:18.858609 (+   255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:18.858611 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:18.858613 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:18.858654 (+    41us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:18.859052 (+   398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:18.859054 (+     2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:18.859130 (+    76us) client_negotiation.cc:769] Sending connection context
1211 15:02:18.859214 (+    84us) client_negotiation.cc:240] Negotiation successful
1211 15:02:18.859313 (+    99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":86,"threads_started":1}
I20251211 15:02:18.859468  7564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:18.852879 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:43841 (local address 127.5.160.190:32791)
1211 15:02:18.852999 (+   120us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:18.853003 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:18.853151 (+   148us) server_negotiation.cc:408] Connection header received
1211 15:02:18.853268 (+   117us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:18.853272 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:18.853316 (+    44us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:18.853378 (+    62us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:18.853895 (+   517us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:18.854625 (+   730us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:18.855579 (+   954us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:18.855774 (+   195us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:18.856638 (+   864us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:18.856655 (+    17us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:18.856658 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:18.856691 (+    33us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:18.858097 (+  1406us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:18.858475 (+   378us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:18.858479 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:18.858480 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:18.858526 (+    46us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:18.858753 (+   227us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:18.858756 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:18.858757 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:18.858952 (+   195us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:18.859059 (+   107us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:18.859258 (+   199us) server_negotiation.cc:300] Negotiation successful
1211 15:02:18.859356 (+    98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:18.895869  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:32791
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:45957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:19.003675  7731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:19.003918  7731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:19.003990  7731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:19.007422  7731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:19.007495  7731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:19.007553  7731 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20251211 15:02:19.007582  7731 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20251211 15:02:19.007638  7731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:02:19.012048  7731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:45957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--webserver_require_spnego=true
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.160.190:32791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:19.013167  7731 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:19.013998  7731 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:19.021294  7736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:19.021358  7731 server_base.cc:1047] running on GCE node
W20251211 15:02:19.021296  7737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:19.021294  7739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:19.021888  7731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:19.022506  7731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:19.023675  7731 hybrid_clock.cc:648] HybridClock initialized: now 1765465339023650 us; error 33 us; skew 500 ppm
Dec 11 15:02:19 dist-test-slave-4k3m krb5kdc[7467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465339, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:19.026542  7731 init.cc:377] Logged in from keytab as kudu/127.5.160.130@KRBTEST.COM (short username kudu)
I20251211 15:02:19.027632  7731 webserver.cc:492] Webserver started at http://127.5.160.130:33243/ using document root <none> and password file <none>
I20251211 15:02:19.028187  7731 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:19.028236  7731 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:19.028409  7731 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:19.030139  7731 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "26c9f4cfbee348308b250097c5730bdb"
format_stamp: "Formatted at 2025-12-11 15:02:19 on dist-test-slave-4k3m"
server_key: "ca46a4361d00500c1ea7ab6da73ee109"
server_key_iv: "d5eeed0800ea3cd62cafd2cca6019fb3"
server_key_version: "encryptionkey@0"
I20251211 15:02:19.030692  7731 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "26c9f4cfbee348308b250097c5730bdb"
format_stamp: "Formatted at 2025-12-11 15:02:19 on dist-test-slave-4k3m"
server_key: "ca46a4361d00500c1ea7ab6da73ee109"
server_key_iv: "d5eeed0800ea3cd62cafd2cca6019fb3"
server_key_version: "encryptionkey@0"
I20251211 15:02:19.034228  7731 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20251211 15:02:19.036634  7746 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:19.037745  7731 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:02:19.037873  7731 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "26c9f4cfbee348308b250097c5730bdb"
format_stamp: "Formatted at 2025-12-11 15:02:19 on dist-test-slave-4k3m"
server_key: "ca46a4361d00500c1ea7ab6da73ee109"
server_key_iv: "d5eeed0800ea3cd62cafd2cca6019fb3"
server_key_version: "encryptionkey@0"
I20251211 15:02:19.037964  7731 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:19.053148  7731 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:19.056295  7731 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:19.056488  7731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:19.057945  7731 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:19.057996  7731 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:19.058048  7731 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:19.058075  7731 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
Dec 11 15:02:19 dist-test-slave-4k3m krb5kdc[7467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465339, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:19.068898  7731 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:37455
I20251211 15:02:19.068928  7861 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:37455 every 8 connection(s)
I20251211 15:02:19.070019  7731 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:02:19.070894  7564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.058751 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:37053 (local address 127.5.160.190:32791)
1211 15:02:19.058875 (+   124us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.058879 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.059732 (+   853us) server_negotiation.cc:408] Connection header received
1211 15:02:19.060651 (+   919us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.060655 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.060721 (+    66us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.060802 (+    81us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:19.062574 (+  1772us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.063369 (+   795us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.064204 (+   835us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.064392 (+   188us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.067183 (+  2791us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:19.067204 (+    21us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:19.067207 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:19.067235 (+    28us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:19.068983 (+  1748us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:19.069464 (+   481us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:19.069467 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:19.069469 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:19.069526 (+    57us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:19.069797 (+   271us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:19.069800 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:19.069802 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:19.070010 (+   208us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:19.070114 (+   104us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.070625 (+   511us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.070758 (+   133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20251211 15:02:19.071498  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 7731
I20251211 15:02:19.071611  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:02:19.071867  5762 external_mini_cluster.cc:1468] Setting key e06c8e1c372a7a26348d81478d14cb23
I20251211 15:02:19.071630  7755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.059092 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:32791 (local address 127.5.160.130:37053)
1211 15:02:19.059586 (+   494us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:19.059622 (+    36us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:19.060389 (+   767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:19.060992 (+   603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:19.061003 (+    11us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:19.061678 (+   675us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:19.062379 (+   701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.062398 (+    19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.063551 (+  1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.063555 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:19.064084 (+   529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.064093 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.064334 (+   241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.065057 (+   723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:19.065094 (+    37us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:19.067001 (+  1907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:19.069096 (+  2095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:19.069100 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:19.069110 (+    10us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:19.069360 (+   250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:19.069613 (+   253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:19.069615 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:19.069617 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:19.069712 (+    95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:19.070109 (+   397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:19.070116 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:19.070360 (+   244us) client_negotiation.cc:769] Sending connection context
1211 15:02:19.070561 (+   201us) client_negotiation.cc:240] Negotiation successful
1211 15:02:19.070839 (+   278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":140,"threads_started":1}
I20251211 15:02:19.073248  7862 heartbeater.cc:344] Connected to a master server at 127.5.160.190:32791
I20251211 15:02:19.075151  7862 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:19.075786  7862 heartbeater.cc:507] Master 127.5.160.190:32791 requested a full tablet report, sending...
I20251211 15:02:19.076797  7512 ts_manager.cc:194] Registered new tserver with Master: 26c9f4cfbee348308b250097c5730bdb (127.5.160.130:37455)
I20251211 15:02:19.077590  7512 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.130@KRBTEST.COM'} at 127.5.160.130:37053
WARNING: no policy specified for kudu/127.5.160.131@KRBTEST.COM; defaulting to no policy
I20251211 15:02:19.083231  7564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.075715 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:52491 (local address 127.5.160.190:32791)
1211 15:02:19.075843 (+   128us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.075848 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.076161 (+   313us) server_negotiation.cc:408] Connection header received
1211 15:02:19.076266 (+   105us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.076269 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.076318 (+    49us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.076395 (+    77us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:19.077140 (+   745us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.077883 (+   743us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.078766 (+   883us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.078983 (+   217us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.080042 (+  1059us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:19.080078 (+    36us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:19.080082 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:19.080109 (+    27us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:19.081617 (+  1508us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:19.082077 (+   460us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:19.082080 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:19.082082 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:19.082132 (+    50us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:19.082345 (+   213us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:19.082348 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:19.082350 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:19.082539 (+   189us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:19.082626 (+    87us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.083000 (+   374us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.083103 (+   103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20251211 15:02:19.083252  7869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.075621 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:32791 (local address 127.5.160.130:52491)
1211 15:02:19.076072 (+   451us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:19.076088 (+    16us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:19.076184 (+    96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:19.076514 (+   330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:19.076517 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:19.076738 (+   221us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:19.077005 (+   267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.077013 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.078033 (+  1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.078037 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:19.078641 (+   604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.078652 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.078768 (+   116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.079492 (+   724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:19.079509 (+    17us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:19.079881 (+   372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:19.081737 (+  1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:19.081741 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:19.081744 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:19.081946 (+   202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:19.082227 (+   281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:19.082229 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:19.082230 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:19.082276 (+    46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:19.082696 (+   420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:19.082699 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:19.082819 (+   120us) client_negotiation.cc:769] Sending connection context
1211 15:02:19.082963 (+   144us) client_negotiation.cc:240] Negotiation successful
1211 15:02:19.083090 (+   127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":125,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:19.122182  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:32791
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:45957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:19.232650  7873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:19.232900  7873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:19.232990  7873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:19.236366  7873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:19.236438  7873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:19.236501  7873 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20251211 15:02:19.236519  7873 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20251211 15:02:19.236570  7873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:02:19.240942  7873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:45957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--webserver_require_spnego=true
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.160.190:32791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:19.242059  7873 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:19.242903  7873 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:19.249827  7878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:19.249825  7879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:19.249825  7881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:19.249962  7873 server_base.cc:1047] running on GCE node
I20251211 15:02:19.250464  7873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:19.251075  7873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:19.252266  7873 hybrid_clock.cc:648] HybridClock initialized: now 1765465339252253 us; error 27 us; skew 500 ppm
Dec 11 15:02:19 dist-test-slave-4k3m krb5kdc[7467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465339, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:19.254895  7873 init.cc:377] Logged in from keytab as kudu/127.5.160.131@KRBTEST.COM (short username kudu)
I20251211 15:02:19.255993  7873 webserver.cc:492] Webserver started at http://127.5.160.131:39401/ using document root <none> and password file <none>
I20251211 15:02:19.256544  7873 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:19.256598  7873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:19.256783  7873 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:19.258482  7873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "702e68d273eb43aca2d07467acadd6fa"
format_stamp: "Formatted at 2025-12-11 15:02:19 on dist-test-slave-4k3m"
server_key: "80fdf296c3473ef5853b4b66dd6cb313"
server_key_iv: "6814493ea7c2346489161163b4754809"
server_key_version: "encryptionkey@0"
I20251211 15:02:19.259016  7873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "702e68d273eb43aca2d07467acadd6fa"
format_stamp: "Formatted at 2025-12-11 15:02:19 on dist-test-slave-4k3m"
server_key: "80fdf296c3473ef5853b4b66dd6cb313"
server_key_iv: "6814493ea7c2346489161163b4754809"
server_key_version: "encryptionkey@0"
I20251211 15:02:19.262485  7873 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20251211 15:02:19.264812  7888 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:19.265965  7873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:02:19.266077  7873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "702e68d273eb43aca2d07467acadd6fa"
format_stamp: "Formatted at 2025-12-11 15:02:19 on dist-test-slave-4k3m"
server_key: "80fdf296c3473ef5853b4b66dd6cb313"
server_key_iv: "6814493ea7c2346489161163b4754809"
server_key_version: "encryptionkey@0"
I20251211 15:02:19.266172  7873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:19.286756  7873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:19.289875  7873 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:19.290055  7873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:19.291618  7873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:19.291673  7873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:19.291726  7873 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:19.291754  7873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
Dec 11 15:02:19 dist-test-slave-4k3m krb5kdc[7467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465339, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:19.302286  7873 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:46629
I20251211 15:02:19.302568  8003 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:46629 every 8 connection(s)
I20251211 15:02:19.303459  7873 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
I20251211 15:02:19.304235  7564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.292453 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:42973 (local address 127.5.160.190:32791)
1211 15:02:19.292592 (+   139us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.292596 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.293420 (+   824us) server_negotiation.cc:408] Connection header received
1211 15:02:19.294306 (+   886us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.294310 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.294371 (+    61us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.294492 (+   121us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:19.296054 (+  1562us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.296559 (+   505us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.297494 (+   935us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.297700 (+   206us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.300229 (+  2529us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:19.300253 (+    24us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:19.300255 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:19.300284 (+    29us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:19.301985 (+  1701us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:19.302582 (+   597us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:19.302586 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:19.302588 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:19.302648 (+    60us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:19.303036 (+   388us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:19.303039 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:19.303041 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:19.303213 (+   172us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:19.303299 (+    86us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.303950 (+   651us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.304083 (+   133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20251211 15:02:19.304833  7897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.292735 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:32791 (local address 127.5.160.131:42973)
1211 15:02:19.293258 (+   523us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:19.293294 (+    36us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:19.294077 (+   783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:19.294638 (+   561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:19.294649 (+    11us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:19.295274 (+   625us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:19.295900 (+   626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.295917 (+    17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.296681 (+   764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.296685 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:19.297323 (+   638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.297334 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.297582 (+   248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.298309 (+   727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:19.298347 (+    38us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:19.300061 (+  1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:19.302140 (+  2079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:19.302146 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:19.302158 (+    12us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:19.302470 (+   312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:19.302763 (+   293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:19.302766 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:19.302768 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:19.302874 (+   106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:19.303322 (+   448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:19.303329 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:19.303616 (+   287us) client_negotiation.cc:769] Sending connection context
1211 15:02:19.303854 (+   238us) client_negotiation.cc:240] Negotiation successful
1211 15:02:19.304154 (+   300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":148,"threads_started":1}
I20251211 15:02:19.306030  8004 heartbeater.cc:344] Connected to a master server at 127.5.160.190:32791
I20251211 15:02:19.306198  8004 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:19.306864  8004 heartbeater.cc:507] Master 127.5.160.190:32791 requested a full tablet report, sending...
I20251211 15:02:19.308116  7514 ts_manager.cc:194] Registered new tserver with Master: 702e68d273eb43aca2d07467acadd6fa (127.5.160.131:46629)
I20251211 15:02:19.308449  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 7873
I20251211 15:02:19.308552  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:02:19.308830  5762 external_mini_cluster.cc:1468] Setting key aad7d8bce96d14dfaf11614cf7469939
I20251211 15:02:19.308954  7514 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.131@KRBTEST.COM'} at 127.5.160.131:42973
I20251211 15:02:19.310782  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251211 15:02:19.315228  7564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.308682 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:36909 (local address 127.5.160.190:32791)
1211 15:02:19.308803 (+   121us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.308807 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.308821 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:02:19.308857 (+    36us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.308860 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.308900 (+    40us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.308962 (+    62us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:19.309594 (+   632us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.310292 (+   698us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.311079 (+   787us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.311261 (+   182us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.312018 (+   757us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:19.312035 (+    17us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:19.312038 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:19.312064 (+    26us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:19.313547 (+  1483us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:19.314031 (+   484us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:19.314035 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:19.314037 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:19.314091 (+    54us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:19.314349 (+   258us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:19.314352 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:19.314354 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:19.314532 (+   178us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:19.314629 (+    97us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.314972 (+   343us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.315099 (+   127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20251211 15:02:19.315235  8010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.308403 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:32791 (local address 127.5.160.131:36909)
1211 15:02:19.308660 (+   257us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:19.308675 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:19.308770 (+    95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:19.308991 (+   221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:19.308994 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:19.309198 (+   204us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:19.309473 (+   275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.309483 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.310422 (+   939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.310426 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:19.310966 (+   540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.310976 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.311087 (+   111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.311596 (+   509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:19.311609 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:19.311900 (+   291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:19.313674 (+  1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:19.313677 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:19.313679 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:19.313909 (+   230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:19.314209 (+   300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:19.314212 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:19.314214 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:19.314267 (+    53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:19.314646 (+   379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:19.314650 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:19.314742 (+    92us) client_negotiation.cc:769] Sending connection context
1211 15:02:19.314855 (+   113us) client_negotiation.cc:240] Negotiation successful
1211 15:02:19.315044 (+   189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":89,"threads_started":1}
Dec 11 15:02:19 dist-test-slave-4k3m krb5kdc[7467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
Dec 11 15:02:19 dist-test-slave-4k3m krb5kdc[7467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:19.335788  7564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.327949 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59570 (local address 127.5.160.190:32791)
1211 15:02:19.328109 (+   160us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.328113 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.328125 (+    12us) server_negotiation.cc:408] Connection header received
1211 15:02:19.328164 (+    39us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.328167 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.328210 (+    43us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.328278 (+    68us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:19.329101 (+   823us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.329604 (+   503us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.330252 (+   648us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.330447 (+   195us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.332645 (+  2198us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:19.332669 (+    24us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:19.332672 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:19.332705 (+    33us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:19.334073 (+  1368us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:19.334545 (+   472us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:19.334547 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:19.334549 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:19.334593 (+    44us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:19.334826 (+   233us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:19.334828 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:19.334830 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:19.335051 (+   221us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:19.335191 (+   140us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.335488 (+   297us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.335630 (+   142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20251211 15:02:19.338611  7514 catalog_manager.cc:2257] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59570:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20251211 15:02:19.341068  7514 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:02:19.353480  8021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.349182 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:37455 (local address 127.0.0.1:43848)
1211 15:02:19.349496 (+   314us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:19.349535 (+    39us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:19.349664 (+   129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:19.350696 (+  1032us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:19.350702 (+     6us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:19.350727 (+    25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:19.351073 (+   346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.351083 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.352327 (+  1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.352330 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:19.352967 (+   637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.352975 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.353075 (+   100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.353137 (+    62us) client_negotiation.cc:769] Sending connection context
1211 15:02:19.353230 (+    93us) client_negotiation.cc:240] Negotiation successful
1211 15:02:19.353327 (+    97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":70,"threads_started":1}
I20251211 15:02:19.354036  8022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.349320 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43848 (local address 127.5.160.130:37455)
1211 15:02:19.349625 (+   305us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.349632 (+     7us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.349659 (+    27us) server_negotiation.cc:408] Connection header received
1211 15:02:19.350296 (+   637us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.350303 (+     7us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.350501 (+   198us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.350702 (+   201us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:19.351214 (+   512us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.352201 (+   987us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.353108 (+   907us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.353625 (+   517us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.353749 (+   124us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.353815 (+    66us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.353902 (+    87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":111,"threads_started":1}
I20251211 15:02:19.354475  8024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.349990 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43568 (local address 127.5.160.131:46629)
1211 15:02:19.350284 (+   294us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.350291 (+     7us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.350314 (+    23us) server_negotiation.cc:408] Connection header received
1211 15:02:19.350379 (+    65us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.350383 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.350507 (+   124us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.350699 (+   192us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:19.351354 (+   655us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.352298 (+   944us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.353578 (+  1280us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.354095 (+   517us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.354195 (+   100us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.354256 (+    61us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.354336 (+    80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":83,"threads_started":1}
I20251211 15:02:19.354642  8025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.350193 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:34441 (local address 127.0.0.1:56126)
1211 15:02:19.350436 (+   243us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:19.350449 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:19.350528 (+    79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:19.351673 (+  1145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:19.351676 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:19.351703 (+    27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:19.351919 (+   216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.351925 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.353235 (+  1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.353239 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:19.354299 (+  1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.354309 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.354406 (+    97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.354421 (+    15us) client_negotiation.cc:769] Sending connection context
1211 15:02:19.354463 (+    42us) client_negotiation.cc:240] Negotiation successful
1211 15:02:19.354531 (+    68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":106,"threads_started":1}
I20251211 15:02:19.355171  8023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.349869 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:46629 (local address 127.0.0.1:43568)
1211 15:02:19.350093 (+   224us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:19.350106 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:19.350183 (+    77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:19.350878 (+   695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:19.350881 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:19.350898 (+    17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:19.351167 (+   269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.351176 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.352391 (+  1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.352395 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:19.353285 (+   890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.353296 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.353383 (+    87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.353399 (+    16us) client_negotiation.cc:769] Sending connection context
1211 15:02:19.353438 (+    39us) client_negotiation.cc:240] Negotiation successful
1211 15:02:19.353493 (+    55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":83,"threads_started":1}
I20251211 15:02:19.355703  8026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.350638 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56126 (local address 127.5.160.129:34441)
1211 15:02:19.351127 (+   489us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.351133 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.351156 (+    23us) server_negotiation.cc:408] Connection header received
1211 15:02:19.351237 (+    81us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.351242 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.351415 (+   173us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.351548 (+   133us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:19.352043 (+   495us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.353109 (+  1066us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.354807 (+  1698us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.355364 (+   557us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.355463 (+    99us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.355526 (+    63us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.355597 (+    71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":75,"threads_started":1}
I20251211 15:02:19.357187  7796 tablet_service.cc:1505] Processing CreateTablet for tablet 27abba7b731d4bc6b2864436fdf600d0 (DEFAULT_TABLE table=test-table [id=02fe5b91a3514f91bc7fb2cb25474887]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:19.357779  7938 tablet_service.cc:1505] Processing CreateTablet for tablet 27abba7b731d4bc6b2864436fdf600d0 (DEFAULT_TABLE table=test-table [id=02fe5b91a3514f91bc7fb2cb25474887]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:19.357797  7654 tablet_service.cc:1505] Processing CreateTablet for tablet 27abba7b731d4bc6b2864436fdf600d0 (DEFAULT_TABLE table=test-table [id=02fe5b91a3514f91bc7fb2cb25474887]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:19.358502  7796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27abba7b731d4bc6b2864436fdf600d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:19.358675  7938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27abba7b731d4bc6b2864436fdf600d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:19.358695  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27abba7b731d4bc6b2864436fdf600d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:19.364266  8027 tablet_bootstrap.cc:492] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28: Bootstrap starting.
I20251211 15:02:19.365419  8029 tablet_bootstrap.cc:492] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa: Bootstrap starting.
I20251211 15:02:19.365419  8028 tablet_bootstrap.cc:492] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb: Bootstrap starting.
I20251211 15:02:19.366634  8027 tablet_bootstrap.cc:654] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:19.367619  8029 tablet_bootstrap.cc:654] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:19.367619  8028 tablet_bootstrap.cc:654] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:19.367998  8027 log.cc:826] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:19.368819  8029 log.cc:826] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:19.368819  8028 log.cc:826] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:19.369812  8027 tablet_bootstrap.cc:492] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28: No bootstrap required, opened a new log
I20251211 15:02:19.370005  8027 ts_tablet_manager.cc:1403] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20251211 15:02:19.370666  8029 tablet_bootstrap.cc:492] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa: No bootstrap required, opened a new log
I20251211 15:02:19.370666  8028 tablet_bootstrap.cc:492] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb: No bootstrap required, opened a new log
I20251211 15:02:19.370872  8028 ts_tablet_manager.cc:1403] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20251211 15:02:19.370874  8029 ts_tablet_manager.cc:1403] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20251211 15:02:19.372557  8027 raft_consensus.cc:359] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } }
I20251211 15:02:19.372783  8027 raft_consensus.cc:385] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:19.372843  8027 raft_consensus.cc:740] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61542c6f98af45d08f8b11a9c6a6fb28, State: Initialized, Role: FOLLOWER
I20251211 15:02:19.373646  8027 consensus_queue.cc:260] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } }
I20251211 15:02:19.373940  8029 raft_consensus.cc:359] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } }
I20251211 15:02:19.373940  8028 raft_consensus.cc:359] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } }
I20251211 15:02:19.374151  8028 raft_consensus.cc:385] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:19.374218  8028 raft_consensus.cc:740] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26c9f4cfbee348308b250097c5730bdb, State: Initialized, Role: FOLLOWER
I20251211 15:02:19.374351  7720 heartbeater.cc:499] Master 127.5.160.190:32791 was elected leader, sending a full tablet report...
I20251211 15:02:19.374496  8027 ts_tablet_manager.cc:1434] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20251211 15:02:19.374159  8029 raft_consensus.cc:385] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:19.374650  8028 consensus_queue.cc:260] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } }
I20251211 15:02:19.374763  8029 raft_consensus.cc:740] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 702e68d273eb43aca2d07467acadd6fa, State: Initialized, Role: FOLLOWER
I20251211 15:02:19.375169  8029 consensus_queue.cc:260] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } }
I20251211 15:02:19.375568  8028 ts_tablet_manager.cc:1434] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20251211 15:02:19.375954  8029 ts_tablet_manager.cc:1434] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20251211 15:02:19.375948  7862 heartbeater.cc:499] Master 127.5.160.190:32791 was elected leader, sending a full tablet report...
I20251211 15:02:19.377420  8004 heartbeater.cc:499] Master 127.5.160.190:32791 was elected leader, sending a full tablet report...
W20251211 15:02:19.554678  8005 tablet.cc:2378] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 15:02:19.554769  8033 raft_consensus.cc:493] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:02:19.555027  8033 raft_consensus.cc:515] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } }
I20251211 15:02:19.556288  8033 leader_election.cc:290] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26c9f4cfbee348308b250097c5730bdb (127.5.160.130:37455), 702e68d273eb43aca2d07467acadd6fa (127.5.160.131:46629)
I20251211 15:02:19.560108  8037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.557054 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:46629 (local address 127.5.160.129:53851)
1211 15:02:19.557315 (+   261us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:19.557329 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:19.557430 (+   101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:19.557707 (+   277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:19.557710 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:19.557728 (+    18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:19.558047 (+   319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.558054 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.558955 (+   901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.558959 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:19.559683 (+   724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.559692 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.559814 (+   122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.559838 (+    24us) client_negotiation.cc:769] Sending connection context
1211 15:02:19.559887 (+    49us) client_negotiation.cc:240] Negotiation successful
1211 15:02:19.559946 (+    59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":90,"threads_started":1}
I20251211 15:02:19.560567  8024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.557183 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:53851 (local address 127.5.160.131:46629)
1211 15:02:19.557313 (+   130us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.557317 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.557441 (+   124us) server_negotiation.cc:408] Connection header received
1211 15:02:19.557525 (+    84us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.557529 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.557583 (+    54us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.557695 (+   112us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:19.558177 (+   482us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.558802 (+   625us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.559809 (+  1007us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.560307 (+   498us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.560346 (+    39us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.560392 (+    46us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.560458 (+    66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20251211 15:02:19.560803  8036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.556632 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:37455 (local address 127.5.160.129:50411)
1211 15:02:19.557012 (+   380us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:19.557026 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:19.557195 (+   169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:19.557549 (+   354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:19.557552 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:19.557596 (+    44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:19.558356 (+   760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.558366 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.559401 (+  1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.559405 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:19.560312 (+   907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.560322 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.560466 (+   144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.560484 (+    18us) client_negotiation.cc:769] Sending connection context
1211 15:02:19.560533 (+    49us) client_negotiation.cc:240] Negotiation successful
1211 15:02:19.560589 (+    56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":157,"threads_started":1}
I20251211 15:02:19.561235  8022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.556777 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:50411 (local address 127.5.160.130:37455)
1211 15:02:19.556976 (+   199us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.556981 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.557104 (+   123us) server_negotiation.cc:408] Connection header received
1211 15:02:19.557369 (+   265us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.557373 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.557437 (+    64us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.557510 (+    73us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:19.558497 (+   987us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.559287 (+   790us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.560472 (+  1185us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.560974 (+   502us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.561014 (+    40us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.561065 (+    51us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.561129 (+    64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20251211 15:02:19.561185  7958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27abba7b731d4bc6b2864436fdf600d0" candidate_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "702e68d273eb43aca2d07467acadd6fa" is_pre_election: true
I20251211 15:02:19.561478  7958 raft_consensus.cc:2468] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61542c6f98af45d08f8b11a9c6a6fb28 in term 0.
I20251211 15:02:19.561807  7816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27abba7b731d4bc6b2864436fdf600d0" candidate_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26c9f4cfbee348308b250097c5730bdb" is_pre_election: true
I20251211 15:02:19.561972  7607 leader_election.cc:304] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61542c6f98af45d08f8b11a9c6a6fb28, 702e68d273eb43aca2d07467acadd6fa; no voters: 
I20251211 15:02:19.562057  7816 raft_consensus.cc:2468] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61542c6f98af45d08f8b11a9c6a6fb28 in term 0.
I20251211 15:02:19.562234  8033 raft_consensus.cc:2804] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:02:19.562318  8033 raft_consensus.cc:493] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:02:19.562366  8033 raft_consensus.cc:3060] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:19.563400  8033 raft_consensus.cc:515] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } }
I20251211 15:02:19.563756  8033 leader_election.cc:290] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [CANDIDATE]: Term 1 election: Requested vote from peers 26c9f4cfbee348308b250097c5730bdb (127.5.160.130:37455), 702e68d273eb43aca2d07467acadd6fa (127.5.160.131:46629)
I20251211 15:02:19.564160  7816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27abba7b731d4bc6b2864436fdf600d0" candidate_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26c9f4cfbee348308b250097c5730bdb"
I20251211 15:02:19.564174  7958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27abba7b731d4bc6b2864436fdf600d0" candidate_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "702e68d273eb43aca2d07467acadd6fa"
I20251211 15:02:19.564283  7816 raft_consensus.cc:3060] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:19.564287  7958 raft_consensus.cc:3060] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:19.565217  7958 raft_consensus.cc:2468] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61542c6f98af45d08f8b11a9c6a6fb28 in term 1.
I20251211 15:02:19.565501  7816 raft_consensus.cc:2468] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61542c6f98af45d08f8b11a9c6a6fb28 in term 1.
I20251211 15:02:19.565539  7607 leader_election.cc:304] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61542c6f98af45d08f8b11a9c6a6fb28, 702e68d273eb43aca2d07467acadd6fa; no voters: 
I20251211 15:02:19.565689  8033 raft_consensus.cc:2804] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:19.566004  8033 raft_consensus.cc:697] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 LEADER]: Becoming Leader. State: Replica: 61542c6f98af45d08f8b11a9c6a6fb28, State: Running, Role: LEADER
I20251211 15:02:19.566385  8033 consensus_queue.cc:237] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } }
I20251211 15:02:19.569759  7512 catalog_manager.cc:5654] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61542c6f98af45d08f8b11a9c6a6fb28 (127.5.160.129). New cstate: current_term: 1 leader_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } health_report { overall_health: HEALTHY } } }
W20251211 15:02:19.571115  7863 tablet.cc:2378] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251211 15:02:19.599521  7721 tablet.cc:2378] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28: Can't schedule compaction. Clean time has not been advanced past its initial value.
Dec 11 15:02:19 dist-test-slave-4k3m krb5kdc[7467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465338, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:19.616521  7564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.608872 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59572 (local address 127.5.160.190:32791)
1211 15:02:19.608999 (+   127us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.609004 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.609187 (+   183us) server_negotiation.cc:408] Connection header received
1211 15:02:19.609317 (+   130us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.609320 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.609356 (+    36us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.609417 (+    61us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:19.610245 (+   828us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.610741 (+   496us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.611350 (+   609us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.611510 (+   160us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.613558 (+  2048us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:19.613574 (+    16us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:19.613576 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:19.613599 (+    23us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:19.615001 (+  1402us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:19.615423 (+   422us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:19.615427 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:19.615429 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:19.615478 (+    49us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:19.615699 (+   221us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:19.615702 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:19.615704 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:19.615851 (+   147us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:19.615932 (+    81us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.616216 (+   284us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.616347 (+   131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":40}
I20251211 15:02:19.616521  8045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.608796 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:32791 (local address 127.0.0.1:59572)
1211 15:02:19.609104 (+   308us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:19.609117 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:19.609233 (+   116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:19.609449 (+   216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:19.609451 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:19.609921 (+   470us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:19.610119 (+   198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.610127 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.610851 (+   724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.610854 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:19.611244 (+   390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.611251 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.611355 (+   104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.611937 (+   582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:19.611950 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:19.613440 (+  1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:19.615095 (+  1655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:19.615104 (+     9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:19.615111 (+     7us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:19.615324 (+   213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:19.615557 (+   233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:19.615560 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:19.615562 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:19.615606 (+    44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:19.615948 (+   342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:19.615955 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:19.616052 (+    97us) client_negotiation.cc:769] Sending connection context
1211 15:02:19.616146 (+    94us) client_negotiation.cc:240] Negotiation successful
1211 15:02:19.616295 (+   149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":117,"threads_started":1}
I20251211 15:02:19.620774  7512 catalog_manager.cc:2257] Servicing CreateTable request from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:59572:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20251211 15:02:19.621466  7512 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:02:19.626487  7796 tablet_service.cc:1505] Processing CreateTablet for tablet cbe34172d9e0453dbcb200c74d994d87 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d14ed622066a4bd9a81ec9bb4ae0058f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20251211 15:02:19.626341  7654 tablet_service.cc:1505] Processing CreateTablet for tablet cbe34172d9e0453dbcb200c74d994d87 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d14ed622066a4bd9a81ec9bb4ae0058f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20251211 15:02:19.626698  7938 tablet_service.cc:1505] Processing CreateTablet for tablet cbe34172d9e0453dbcb200c74d994d87 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d14ed622066a4bd9a81ec9bb4ae0058f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20251211 15:02:19.627084  7796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe34172d9e0453dbcb200c74d994d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:19.627089  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe34172d9e0453dbcb200c74d994d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:19.627211  7938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe34172d9e0453dbcb200c74d994d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:19.629457  8028 tablet_bootstrap.cc:492] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb: Bootstrap starting.
I20251211 15:02:19.629931  8029 tablet_bootstrap.cc:492] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa: Bootstrap starting.
I20251211 15:02:19.630245  8027 tablet_bootstrap.cc:492] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28: Bootstrap starting.
I20251211 15:02:19.630470  8028 tablet_bootstrap.cc:654] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:19.631007  8029 tablet_bootstrap.cc:654] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:19.631309  8027 tablet_bootstrap.cc:654] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:19.631647  8028 tablet_bootstrap.cc:492] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb: No bootstrap required, opened a new log
I20251211 15:02:19.631727  8028 ts_tablet_manager.cc:1403] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.002s
I20251211 15:02:19.632206  8028 raft_consensus.cc:359] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:19.632337  8029 tablet_bootstrap.cc:492] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa: No bootstrap required, opened a new log
I20251211 15:02:19.632341  8028 raft_consensus.cc:385] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:19.632381  8028 raft_consensus.cc:740] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26c9f4cfbee348308b250097c5730bdb, State: Initialized, Role: FOLLOWER
I20251211 15:02:19.632423  8029 ts_tablet_manager.cc:1403] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa: Time spent bootstrapping tablet: real 0.003s	user 0.000s	sys 0.002s
I20251211 15:02:19.632508  8028 consensus_queue.cc:260] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:19.632778  8028 ts_tablet_manager.cc:1434] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20251211 15:02:19.632782  8034 tablet_replica.cc:442] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } }
I20251211 15:02:19.632856  8029 raft_consensus.cc:359] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:19.632929  8034 tablet_replica.cc:445] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:02:19.632972  8029 raft_consensus.cc:385] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:19.633003  8029 raft_consensus.cc:740] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 702e68d273eb43aca2d07467acadd6fa, State: Initialized, Role: FOLLOWER
I20251211 15:02:19.633118  8029 consensus_queue.cc:260] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:19.633371  8029 ts_tablet_manager.cc:1434] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20251211 15:02:19.633847  8035 tablet_replica.cc:442] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } }
I20251211 15:02:19.633977  8027 tablet_bootstrap.cc:492] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28: No bootstrap required, opened a new log
I20251211 15:02:19.633985  8035 tablet_replica.cc:445] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:02:19.634063  8027 ts_tablet_manager.cc:1403] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28: Time spent bootstrapping tablet: real 0.004s	user 0.002s	sys 0.000s
I20251211 15:02:19.634513  8027 raft_consensus.cc:359] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:19.634616  8027 raft_consensus.cc:385] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:19.634649  8027 raft_consensus.cc:740] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61542c6f98af45d08f8b11a9c6a6fb28, State: Initialized, Role: FOLLOWER
I20251211 15:02:19.634780  8027 consensus_queue.cc:260] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:19.635049  8033 tablet_replica.cc:442] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } }
I20251211 15:02:19.635159  8033 tablet_replica.cc:445] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:02:19.635810  8027 ts_tablet_manager.cc:1434] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.001s
I20251211 15:02:19.882078  8035 raft_consensus.cc:493] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:02:19.882354  8035 raft_consensus.cc:515] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:19.883893  8035 leader_election.cc:290] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61542c6f98af45d08f8b11a9c6a6fb28 (127.5.160.129:34441), 26c9f4cfbee348308b250097c5730bdb (127.5.160.130:37455)
I20251211 15:02:19.888355  8051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.884840 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:37455 (local address 127.5.160.131:48143)
1211 15:02:19.885052 (+   212us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:19.885065 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:19.885134 (+    69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:19.885442 (+   308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:19.885445 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:19.885460 (+    15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:19.885670 (+   210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.885677 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.886808 (+  1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.886812 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:19.887863 (+  1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.887870 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.888011 (+   141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.888034 (+    23us) client_negotiation.cc:769] Sending connection context
1211 15:02:19.888085 (+    51us) client_negotiation.cc:240] Negotiation successful
1211 15:02:19.888158 (+    73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":70,"threads_started":1}
I20251211 15:02:19.888365  8049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.884305 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:34441 (local address 127.5.160.131:37547)
1211 15:02:19.884696 (+   391us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:19.884717 (+    21us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:19.884830 (+   113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:19.885269 (+   439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:19.885271 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:19.885284 (+    13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:19.885553 (+   269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.885561 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.886808 (+  1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.886812 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:19.887848 (+  1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.887861 (+    13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.888010 (+   149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.888034 (+    24us) client_negotiation.cc:769] Sending connection context
1211 15:02:19.888107 (+    73us) client_negotiation.cc:240] Negotiation successful
1211 15:02:19.888157 (+    50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":169,"threads_started":1}
I20251211 15:02:19.888909  8022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.884983 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:48143 (local address 127.5.160.130:37455)
1211 15:02:19.885134 (+   151us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.885140 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.885210 (+    70us) server_negotiation.cc:408] Connection header received
1211 15:02:19.885270 (+    60us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.885273 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.885323 (+    50us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.885401 (+    78us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:19.885804 (+   403us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.886621 (+   817us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.888035 (+  1414us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.888586 (+   551us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.888625 (+    39us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.888689 (+    64us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.888764 (+    75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20251211 15:02:19.888914  8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.884476 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:37547 (local address 127.5.160.129:34441)
1211 15:02:19.884792 (+   316us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.884799 (+     7us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.884827 (+    28us) server_negotiation.cc:408] Connection header received
1211 15:02:19.885019 (+   192us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.885024 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.885098 (+    74us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.885244 (+   146us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:19.885737 (+   493us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.886660 (+   923us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.888035 (+  1375us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.888572 (+   537us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.888625 (+    53us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.888687 (+    62us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.888764 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":103,"threads_started":1}
I20251211 15:02:19.889662  7816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbe34172d9e0453dbcb200c74d994d87" candidate_uuid: "702e68d273eb43aca2d07467acadd6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26c9f4cfbee348308b250097c5730bdb" is_pre_election: true
I20251211 15:02:19.889648  7674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbe34172d9e0453dbcb200c74d994d87" candidate_uuid: "702e68d273eb43aca2d07467acadd6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" is_pre_election: true
I20251211 15:02:19.889863  7816 raft_consensus.cc:2468] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 702e68d273eb43aca2d07467acadd6fa in term 0.
I20251211 15:02:19.889920  7674 raft_consensus.cc:2468] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 702e68d273eb43aca2d07467acadd6fa in term 0.
I20251211 15:02:19.890332  7891 leader_election.cc:304] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26c9f4cfbee348308b250097c5730bdb, 702e68d273eb43aca2d07467acadd6fa; no voters: 
I20251211 15:02:19.890655  8035 raft_consensus.cc:2804] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:02:19.890744  8035 raft_consensus.cc:493] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:02:19.890789  8035 raft_consensus.cc:3060] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:19.891929  8035 raft_consensus.cc:515] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:19.892374  8035 leader_election.cc:290] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [CANDIDATE]: Term 1 election: Requested vote from peers 61542c6f98af45d08f8b11a9c6a6fb28 (127.5.160.129:34441), 26c9f4cfbee348308b250097c5730bdb (127.5.160.130:37455)
I20251211 15:02:19.892930  7816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbe34172d9e0453dbcb200c74d994d87" candidate_uuid: "702e68d273eb43aca2d07467acadd6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26c9f4cfbee348308b250097c5730bdb"
I20251211 15:02:19.892927  7674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbe34172d9e0453dbcb200c74d994d87" candidate_uuid: "702e68d273eb43aca2d07467acadd6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61542c6f98af45d08f8b11a9c6a6fb28"
I20251211 15:02:19.893090  7674 raft_consensus.cc:3060] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:19.893090  7816 raft_consensus.cc:3060] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:19.894281  7816 raft_consensus.cc:2468] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 702e68d273eb43aca2d07467acadd6fa in term 1.
I20251211 15:02:19.894281  7674 raft_consensus.cc:2468] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 702e68d273eb43aca2d07467acadd6fa in term 1.
I20251211 15:02:19.894650  7891 leader_election.cc:304] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61542c6f98af45d08f8b11a9c6a6fb28, 702e68d273eb43aca2d07467acadd6fa; no voters: 
I20251211 15:02:19.894886  8035 raft_consensus.cc:2804] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:19.895179  8035 raft_consensus.cc:697] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [term 1 LEADER]: Becoming Leader. State: Replica: 702e68d273eb43aca2d07467acadd6fa, State: Running, Role: LEADER
I20251211 15:02:19.895705  8035 consensus_queue.cc:237] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:19.898413  8052 tablet_replica.cc:442] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa: TxnStatusTablet state changed. Reason: New leader 702e68d273eb43aca2d07467acadd6fa. Latest consensus state: current_term: 1 leader_uuid: "702e68d273eb43aca2d07467acadd6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } }
I20251211 15:02:19.898622  8052 tablet_replica.cc:445] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa: This TxnStatusTablet replica's current role is: LEADER
I20251211 15:02:19.899019  8054 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20251211 15:02:19.899292  8054 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20251211 15:02:19.899966  7515 catalog_manager.cc:5654] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 702e68d273eb43aca2d07467acadd6fa (127.5.160.131). New cstate: current_term: 1 leader_uuid: "702e68d273eb43aca2d07467acadd6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } health_report { overall_health: HEALTHY } } }
I20251211 15:02:19.933506  8045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.930094 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:46629 (local address 127.0.0.1:43570)
1211 15:02:19.930272 (+   178us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:19.930290 (+    18us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:19.930434 (+   144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:19.930790 (+   356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:19.930793 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:19.930802 (+     9us) client_negotiation.cc:189] Negotiated authn=TOKEN
1211 15:02:19.931057 (+   255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.931064 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.931763 (+   699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.931767 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:19.932195 (+   428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.932201 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.932304 (+   103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.932359 (+    55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
1211 15:02:19.933200 (+   841us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
1211 15:02:19.933218 (+    18us) client_negotiation.cc:769] Sending connection context
1211 15:02:19.933280 (+    62us) client_negotiation.cc:240] Negotiation successful
1211 15:02:19.933364 (+    84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20251211 15:02:19.933506  8024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.930292 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43570 (local address 127.5.160.131:46629)
1211 15:02:19.930529 (+   237us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.930534 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.930551 (+    17us) server_negotiation.cc:408] Connection header received
1211 15:02:19.930624 (+    73us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.930626 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.930687 (+    61us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.930767 (+    80us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:02:19.931160 (+   393us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.931658 (+   498us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.932298 (+   640us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.932500 (+   202us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.932553 (+    53us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:02:19.933104 (+   551us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:02:19.933210 (+   106us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.933296 (+    86us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.933354 (+    58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20251211 15:02:19.939327  7816 raft_consensus.cc:1275] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Refusing update from remote peer 702e68d273eb43aca2d07467acadd6fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:19.939507  7674 raft_consensus.cc:1275] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Refusing update from remote peer 702e68d273eb43aca2d07467acadd6fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:19.940117  8052 consensus_queue.cc:1048] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:19.940505  8035 consensus_queue.cc:1048] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:19.944780  8033 tablet_replica.cc:442] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28: TxnStatusTablet state changed. Reason: New leader 702e68d273eb43aca2d07467acadd6fa. Latest consensus state: current_term: 1 leader_uuid: "702e68d273eb43aca2d07467acadd6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } }
I20251211 15:02:19.944957  8033 tablet_replica.cc:445] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:02:19.946111  8034 tablet_replica.cc:442] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb: TxnStatusTablet state changed. Reason: New leader 702e68d273eb43aca2d07467acadd6fa. Latest consensus state: current_term: 1 leader_uuid: "702e68d273eb43aca2d07467acadd6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } }
I20251211 15:02:19.946255  8034 tablet_replica.cc:445] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:02:19.949594  8057 mvcc.cc:204] Tried to move back new op lower bound from 7231346032383455232 to 7231346032216494080. Current Snapshot: MvccSnapshot[applied={T|T < 7231346032383455232}]
I20251211 15:02:19.949819  8035 tablet_replica.cc:442] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "702e68d273eb43aca2d07467acadd6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } }
I20251211 15:02:19.949931  8035 tablet_replica.cc:445] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa: This TxnStatusTablet replica's current role is: LEADER
I20251211 15:02:19.950074  8034 tablet_replica.cc:442] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "702e68d273eb43aca2d07467acadd6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } }
I20251211 15:02:19.950219  8034 tablet_replica.cc:445] T cbe34172d9e0453dbcb200c74d994d87 P 26c9f4cfbee348308b250097c5730bdb: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:02:19.950090  8058 mvcc.cc:204] Tried to move back new op lower bound from 7231346032383455232 to 7231346032216494080. Current Snapshot: MvccSnapshot[applied={T|T < 7231346032383455232}]
I20251211 15:02:19.952158  8035 tablet_replica.cc:442] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "702e68d273eb43aca2d07467acadd6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } }
I20251211 15:02:19.953451  8033 tablet_replica.cc:442] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "702e68d273eb43aca2d07467acadd6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } } }
I20251211 15:02:19.953608  8033 tablet_replica.cc:445] T cbe34172d9e0453dbcb200c74d994d87 P 61542c6f98af45d08f8b11a9c6a6fb28: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:02:19.953990  8059 mvcc.cc:204] Tried to move back new op lower bound from 7231346032383455232 to 7231346032216494080. Current Snapshot: MvccSnapshot[applied={T|T < 7231346032383455232}]
I20251211 15:02:19.954288  8035 tablet_replica.cc:445] T cbe34172d9e0453dbcb200c74d994d87 P 702e68d273eb43aca2d07467acadd6fa: This TxnStatusTablet replica's current role is: LEADER
I20251211 15:02:19.964246  8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.959926 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56134 (local address 127.5.160.129:34441)
1211 15:02:19.960091 (+   165us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.960096 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.960490 (+   394us) server_negotiation.cc:408] Connection header received
1211 15:02:19.960678 (+   188us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.960681 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.960786 (+   105us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.960885 (+    99us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:02:19.961415 (+   530us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.962015 (+   600us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.963057 (+  1042us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.963229 (+   172us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.963293 (+    64us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:02:19.963843 (+   550us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:02:19.963942 (+    99us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.964043 (+   101us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.964099 (+    56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20251211 15:02:19.975893  8069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.972750 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:46629 (local address 127.5.160.129:45973)
1211 15:02:19.973122 (+   372us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:19.973137 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:19.973268 (+   131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:19.973508 (+   240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:19.973511 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:19.973520 (+     9us) client_negotiation.cc:189] Negotiated authn=TOKEN
1211 15:02:19.973850 (+   330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.973858 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.974613 (+   755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.974617 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:19.975130 (+   513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:19.975139 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.975247 (+   108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.975296 (+    49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
1211 15:02:19.975599 (+   303us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
1211 15:02:19.975606 (+     7us) client_negotiation.cc:769] Sending connection context
1211 15:02:19.975662 (+    56us) client_negotiation.cc:240] Negotiation successful
1211 15:02:19.975745 (+    83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":167,"threads_started":1}
I20251211 15:02:19.975869  8024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:19.972806 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:45973 (local address 127.5.160.131:46629)
1211 15:02:19.972924 (+   118us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:19.972928 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:19.973221 (+   293us) server_negotiation.cc:408] Connection header received
1211 15:02:19.973365 (+   144us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:19.973369 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:19.973415 (+    46us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:19.973489 (+    74us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:02:19.973956 (+   467us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.974502 (+   546us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:19.975233 (+   731us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:19.975401 (+   168us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:19.975454 (+    53us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:02:19.975522 (+    68us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:02:19.975581 (+    59us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:19.975681 (+   100us) server_negotiation.cc:300] Negotiation successful
1211 15:02:19.975728 (+    47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20251211 15:02:19.984066  7816 raft_consensus.cc:1275] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Refusing update from remote peer 61542c6f98af45d08f8b11a9c6a6fb28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:19.984684  8038 consensus_queue.cc:1048] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:19.984980  7958 raft_consensus.cc:1275] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Refusing update from remote peer 61542c6f98af45d08f8b11a9c6a6fb28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:19.986811  8038 consensus_queue.cc:1048] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:20.012565  8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:20.008918 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:43265 (local address 127.5.160.129:34441)
1211 15:02:20.009091 (+   173us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:20.009094 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:20.009274 (+   180us) server_negotiation.cc:408] Connection header received
1211 15:02:20.009468 (+   194us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:20.009470 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:20.009550 (+    80us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:20.009624 (+    74us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:02:20.010197 (+   573us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:20.010860 (+   663us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:20.011910 (+  1050us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:20.012077 (+   167us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:20.012123 (+    46us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:02:20.012202 (+    79us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:02:20.012262 (+    60us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:20.012384 (+   122us) server_negotiation.cc:300] Negotiation successful
1211 15:02:20.012433 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20251211 15:02:20.012662  8074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:20.008760 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:34441 (local address 127.5.160.131:43265)
1211 15:02:20.009163 (+   403us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:20.009182 (+    19us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:20.009347 (+   165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:20.009653 (+   306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:20.009656 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:20.009677 (+    21us) client_negotiation.cc:189] Negotiated authn=TOKEN
1211 15:02:20.010060 (+   383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:20.010068 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:20.011025 (+   957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:20.011029 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:20.011762 (+   733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:20.011774 (+    12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:20.011902 (+   128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:20.011966 (+    64us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
1211 15:02:20.012292 (+   326us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
1211 15:02:20.012298 (+     6us) client_negotiation.cc:769] Sending connection context
1211 15:02:20.012368 (+    70us) client_negotiation.cc:240] Negotiation successful
1211 15:02:20.012465 (+    97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":127,"threads_started":1}
I20251211 15:02:20.047024  7515 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59570:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:20.047291  7515 catalog_manager.cc:2755] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59570:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:20.050776  7515 catalog_manager.cc:5941] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273: Sending DeleteTablet for 3 replicas of tablet 27abba7b731d4bc6b2864436fdf600d0
I20251211 15:02:20.051776  7796 tablet_service.cc:1552] Processing DeleteTablet for tablet 27abba7b731d4bc6b2864436fdf600d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:20 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:43848
I20251211 15:02:20.052388  7938 tablet_service.cc:1552] Processing DeleteTablet for tablet 27abba7b731d4bc6b2864436fdf600d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:20 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:43568
I20251211 15:02:20.052542  7654 tablet_service.cc:1552] Processing DeleteTablet for tablet 27abba7b731d4bc6b2864436fdf600d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:20 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:56126
I20251211 15:02:20.053254  8080 tablet_replica.cc:333] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa: stopping tablet replica
I20251211 15:02:20.053925  8079 tablet_replica.cc:333] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb: stopping tablet replica
I20251211 15:02:20.054044  7515 catalog_manager.cc:2257] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59570:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20251211 15:02:20.054368  8079 raft_consensus.cc:2243] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:02:20.054637  8079 raft_consensus.cc:2272] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Raft consensus is shut down!
W20251211 15:02:20.054695  7515 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:02:20.055444  8080 raft_consensus.cc:2243] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:02:20.056142  8080 raft_consensus.cc:2272] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:20.056589  8081 tablet_replica.cc:333] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28: stopping tablet replica
I20251211 15:02:20.056898  8081 raft_consensus.cc:2243] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 LEADER]: Raft consensus shutting down.
I20251211 15:02:20.057350  8081 raft_consensus.cc:2272] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:20.058868  8081 ts_tablet_manager.cc:1916] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:20.062016  8081 ts_tablet_manager.cc:1929] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20251211 15:02:20.062191  8081 log.cc:1199] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/wal/wals/27abba7b731d4bc6b2864436fdf600d0
I20251211 15:02:20.062546  8081 ts_tablet_manager.cc:1950] T 27abba7b731d4bc6b2864436fdf600d0 P 61542c6f98af45d08f8b11a9c6a6fb28: Deleting consensus metadata
I20251211 15:02:20.064208  7654 tablet_service.cc:1505] Processing CreateTablet for tablet b8e66ce2cd364c549facbf026059362c (DEFAULT_TABLE table=test-table [id=7fffa4a0d67e49f69fd7f15dbd31af93]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:20.064618  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e66ce2cd364c549facbf026059362c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:20.065093  8079 ts_tablet_manager.cc:1916] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:20.067313  7796 tablet_service.cc:1505] Processing CreateTablet for tablet b8e66ce2cd364c549facbf026059362c (DEFAULT_TABLE table=test-table [id=7fffa4a0d67e49f69fd7f15dbd31af93]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:20.067961  7938 tablet_service.cc:1505] Processing CreateTablet for tablet b8e66ce2cd364c549facbf026059362c (DEFAULT_TABLE table=test-table [id=7fffa4a0d67e49f69fd7f15dbd31af93]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:20.068307  7938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e66ce2cd364c549facbf026059362c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:20.069021  8079 ts_tablet_manager.cc:1929] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20251211 15:02:20.069191  8079 log.cc:1199] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/wal/wals/27abba7b731d4bc6b2864436fdf600d0
I20251211 15:02:20.069555  8079 ts_tablet_manager.cc:1950] T 27abba7b731d4bc6b2864436fdf600d0 P 26c9f4cfbee348308b250097c5730bdb: Deleting consensus metadata
I20251211 15:02:20.071298  7501 catalog_manager.cc:4985] TS 26c9f4cfbee348308b250097c5730bdb (127.5.160.130:37455): tablet 27abba7b731d4bc6b2864436fdf600d0 (table test-table [id=02fe5b91a3514f91bc7fb2cb25474887]) successfully deleted
I20251211 15:02:20.071527  7796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e66ce2cd364c549facbf026059362c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:20.071549  7501 catalog_manager.cc:4985] TS 61542c6f98af45d08f8b11a9c6a6fb28 (127.5.160.129:34441): tablet 27abba7b731d4bc6b2864436fdf600d0 (table test-table [id=02fe5b91a3514f91bc7fb2cb25474887]) successfully deleted
I20251211 15:02:20.074441  8028 tablet_bootstrap.cc:492] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb: Bootstrap starting.
I20251211 15:02:20.075850  8028 tablet_bootstrap.cc:654] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:20.077431  8029 tablet_bootstrap.cc:492] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa: Bootstrap starting.
I20251211 15:02:20.079445  8029 tablet_bootstrap.cc:654] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:20.082249  8027 tablet_bootstrap.cc:492] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28: Bootstrap starting.
I20251211 15:02:20.082906  8080 ts_tablet_manager.cc:1916] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:20.083719  8027 tablet_bootstrap.cc:654] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:20.086457  8080 ts_tablet_manager.cc:1929] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20251211 15:02:20.086591  8080 log.cc:1199] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/wal/wals/27abba7b731d4bc6b2864436fdf600d0
I20251211 15:02:20.087328  8027 tablet_bootstrap.cc:492] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28: No bootstrap required, opened a new log
I20251211 15:02:20.087458  8027 ts_tablet_manager.cc:1403] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.002s
I20251211 15:02:20.088111  8027 raft_consensus.cc:359] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:20.088256  8027 raft_consensus.cc:385] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:20.088294  8027 raft_consensus.cc:740] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61542c6f98af45d08f8b11a9c6a6fb28, State: Initialized, Role: FOLLOWER
I20251211 15:02:20.088435  8027 consensus_queue.cc:260] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:20.088768  8027 ts_tablet_manager.cc:1434] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20251211 15:02:20.092903  8029 tablet_bootstrap.cc:492] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa: No bootstrap required, opened a new log
I20251211 15:02:20.093050  8029 ts_tablet_manager.cc:1403] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa: Time spent bootstrapping tablet: real 0.016s	user 0.003s	sys 0.000s
I20251211 15:02:20.093705  8029 raft_consensus.cc:359] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:20.093856  8029 raft_consensus.cc:385] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:20.093895  8029 raft_consensus.cc:740] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 702e68d273eb43aca2d07467acadd6fa, State: Initialized, Role: FOLLOWER
I20251211 15:02:20.094049  8029 consensus_queue.cc:260] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:20.094358  8029 ts_tablet_manager.cc:1434] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20251211 15:02:20.095054  8080 ts_tablet_manager.cc:1950] T 27abba7b731d4bc6b2864436fdf600d0 P 702e68d273eb43aca2d07467acadd6fa: Deleting consensus metadata
I20251211 15:02:20.096534  7501 catalog_manager.cc:4985] TS 702e68d273eb43aca2d07467acadd6fa (127.5.160.131:46629): tablet 27abba7b731d4bc6b2864436fdf600d0 (table test-table [id=02fe5b91a3514f91bc7fb2cb25474887]) successfully deleted
I20251211 15:02:20.099714  8028 tablet_bootstrap.cc:492] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb: No bootstrap required, opened a new log
I20251211 15:02:20.099849  8028 ts_tablet_manager.cc:1403] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb: Time spent bootstrapping tablet: real 0.025s	user 0.001s	sys 0.001s
I20251211 15:02:20.100353  8028 raft_consensus.cc:359] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:20.100497  8028 raft_consensus.cc:385] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:20.100539  8028 raft_consensus.cc:740] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26c9f4cfbee348308b250097c5730bdb, State: Initialized, Role: FOLLOWER
I20251211 15:02:20.100678  8028 consensus_queue.cc:260] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:20.100958  8028 ts_tablet_manager.cc:1434] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.001s
I20251211 15:02:20.219303  8077 raft_consensus.cc:493] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:02:20.219508  8077 raft_consensus.cc:515] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:20.219975  8077 leader_election.cc:290] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61542c6f98af45d08f8b11a9c6a6fb28 (127.5.160.129:34441), 26c9f4cfbee348308b250097c5730bdb (127.5.160.130:37455)
I20251211 15:02:20.220526  7816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b8e66ce2cd364c549facbf026059362c" candidate_uuid: "702e68d273eb43aca2d07467acadd6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26c9f4cfbee348308b250097c5730bdb" is_pre_election: true
I20251211 15:02:20.220535  7674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b8e66ce2cd364c549facbf026059362c" candidate_uuid: "702e68d273eb43aca2d07467acadd6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" is_pre_election: true
I20251211 15:02:20.220679  7816 raft_consensus.cc:2468] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 702e68d273eb43aca2d07467acadd6fa in term 0.
I20251211 15:02:20.220691  7674 raft_consensus.cc:2468] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 702e68d273eb43aca2d07467acadd6fa in term 0.
I20251211 15:02:20.221009  7891 leader_election.cc:304] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26c9f4cfbee348308b250097c5730bdb, 702e68d273eb43aca2d07467acadd6fa; no voters: 
I20251211 15:02:20.221203  8077 raft_consensus.cc:2804] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:02:20.221267  8077 raft_consensus.cc:493] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:02:20.221308  8077 raft_consensus.cc:3060] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:20.222322  8077 raft_consensus.cc:515] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:20.222688  8077 leader_election.cc:290] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [CANDIDATE]: Term 1 election: Requested vote from peers 61542c6f98af45d08f8b11a9c6a6fb28 (127.5.160.129:34441), 26c9f4cfbee348308b250097c5730bdb (127.5.160.130:37455)
I20251211 15:02:20.223093  7674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b8e66ce2cd364c549facbf026059362c" candidate_uuid: "702e68d273eb43aca2d07467acadd6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61542c6f98af45d08f8b11a9c6a6fb28"
I20251211 15:02:20.223209  7674 raft_consensus.cc:3060] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:20.223248  7816 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b8e66ce2cd364c549facbf026059362c" candidate_uuid: "702e68d273eb43aca2d07467acadd6fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26c9f4cfbee348308b250097c5730bdb"
I20251211 15:02:20.223469  7816 raft_consensus.cc:3060] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:20.224185  7674 raft_consensus.cc:2468] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 702e68d273eb43aca2d07467acadd6fa in term 1.
I20251211 15:02:20.224483  7891 leader_election.cc:304] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61542c6f98af45d08f8b11a9c6a6fb28, 702e68d273eb43aca2d07467acadd6fa; no voters: 
I20251211 15:02:20.224659  8077 raft_consensus.cc:2804] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:20.224732  8077 raft_consensus.cc:697] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [term 1 LEADER]: Becoming Leader. State: Replica: 702e68d273eb43aca2d07467acadd6fa, State: Running, Role: LEADER
I20251211 15:02:20.224742  7816 raft_consensus.cc:2468] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 702e68d273eb43aca2d07467acadd6fa in term 1.
I20251211 15:02:20.224872  8077 consensus_queue.cc:237] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:20.226878  7514 catalog_manager.cc:5654] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 702e68d273eb43aca2d07467acadd6fa (127.5.160.131). New cstate: current_term: 1 leader_uuid: "702e68d273eb43aca2d07467acadd6fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } health_report { overall_health: HEALTHY } } }
I20251211 15:02:20.261128  8024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:20.258583 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43584 (local address 127.5.160.131:46629)
1211 15:02:20.258740 (+   157us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:20.258745 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:20.258762 (+    17us) server_negotiation.cc:408] Connection header received
1211 15:02:20.258861 (+    99us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:20.258865 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:20.258913 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:20.259011 (+    98us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:02:20.259359 (+   348us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:20.259850 (+   491us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:20.260468 (+   618us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:20.260638 (+   170us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:20.260683 (+    45us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:02:20.260754 (+    71us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:02:20.260821 (+    67us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:20.260933 (+   112us) server_negotiation.cc:300] Negotiation successful
1211 15:02:20.260985 (+    52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20251211 15:02:20.271209  8024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:20.268320 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:59145 (local address 127.5.160.131:46629)
1211 15:02:20.268428 (+   108us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:20.268432 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:20.268445 (+    13us) server_negotiation.cc:408] Connection header received
1211 15:02:20.268589 (+   144us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:20.268592 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:20.268635 (+    43us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:20.268693 (+    58us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:02:20.269171 (+   478us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:20.269736 (+   565us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:20.270459 (+   723us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:20.270657 (+   198us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:20.270694 (+    37us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:02:20.270781 (+    87us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:02:20.270843 (+    62us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:20.270972 (+   129us) server_negotiation.cc:300] Negotiation successful
1211 15:02:20.271017 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20251211 15:02:20.271209  8074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:20.268205 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:46629 (local address 127.5.160.131:59145)
1211 15:02:20.268364 (+   159us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:20.268382 (+    18us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:20.268483 (+   101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:20.268706 (+   223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:20.268709 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:20.268716 (+     7us) client_negotiation.cc:189] Negotiated authn=TOKEN
1211 15:02:20.269038 (+   322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:20.269050 (+    12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:20.269850 (+   800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:20.269854 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:20.270356 (+   502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:20.270365 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:20.270472 (+   107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:20.270507 (+    35us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
1211 15:02:20.270857 (+   350us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
1211 15:02:20.270862 (+     5us) client_negotiation.cc:769] Sending connection context
1211 15:02:20.270921 (+    59us) client_negotiation.cc:240] Negotiation successful
1211 15:02:20.271034 (+   113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20251211 15:02:20.277910  7674 raft_consensus.cc:1275] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Refusing update from remote peer 702e68d273eb43aca2d07467acadd6fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:20.277910  7816 raft_consensus.cc:1275] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Refusing update from remote peer 702e68d273eb43aca2d07467acadd6fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:20.278400  8052 consensus_queue.cc:1048] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:20.278559  8077 consensus_queue.cc:1048] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251211 15:02:20.295048  8057 tablet_replica.cc:1306] Aborted: operation has been aborted: cancelling pending write operations
I20251211 15:02:21.851119  7514 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59570:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:21.851277  7514 catalog_manager.cc:2755] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59570:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:21.853919  7514 catalog_manager.cc:5941] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273: Sending DeleteTablet for 3 replicas of tablet b8e66ce2cd364c549facbf026059362c
I20251211 15:02:21.854578  7654 tablet_service.cc:1552] Processing DeleteTablet for tablet b8e66ce2cd364c549facbf026059362c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:21 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:56126
I20251211 15:02:21.854597  7796 tablet_service.cc:1552] Processing DeleteTablet for tablet b8e66ce2cd364c549facbf026059362c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:21 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:43848
I20251211 15:02:21.854712  7938 tablet_service.cc:1552] Processing DeleteTablet for tablet b8e66ce2cd364c549facbf026059362c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:21 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:43568
I20251211 15:02:21.854954  8110 tablet_replica.cc:333] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28: stopping tablet replica
I20251211 15:02:21.855043  8112 tablet_replica.cc:333] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa: stopping tablet replica
I20251211 15:02:21.855070  8110 raft_consensus.cc:2243] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:02:21.855155  8112 raft_consensus.cc:2243] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [term 1 LEADER]: Raft consensus shutting down.
I20251211 15:02:21.855188  8110 raft_consensus.cc:2272] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:21.855394  8111 tablet_replica.cc:333] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb: stopping tablet replica
I20251211 15:02:21.855494  8112 raft_consensus.cc:2272] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:21.855510  8111 raft_consensus.cc:2243] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:02:21.855611  8111 raft_consensus.cc:2272] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:21.856137  8112 ts_tablet_manager.cc:1916] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:21.858630  8111 ts_tablet_manager.cc:1916] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:21.858913  8112 ts_tablet_manager.cc:1929] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20251211 15:02:21.859046  8112 log.cc:1199] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/wal/wals/b8e66ce2cd364c549facbf026059362c
I20251211 15:02:21.859375  8112 ts_tablet_manager.cc:1950] T b8e66ce2cd364c549facbf026059362c P 702e68d273eb43aca2d07467acadd6fa: Deleting consensus metadata
I20251211 15:02:21.859449  8110 ts_tablet_manager.cc:1916] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:21.860234  7501 catalog_manager.cc:4985] TS 702e68d273eb43aca2d07467acadd6fa (127.5.160.131:46629): tablet b8e66ce2cd364c549facbf026059362c (table test-table [id=7fffa4a0d67e49f69fd7f15dbd31af93]) successfully deleted
I20251211 15:02:21.861514  8111 ts_tablet_manager.cc:1929] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20251211 15:02:21.861583  8111 log.cc:1199] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/wal/wals/b8e66ce2cd364c549facbf026059362c
I20251211 15:02:21.861814  8111 ts_tablet_manager.cc:1950] T b8e66ce2cd364c549facbf026059362c P 26c9f4cfbee348308b250097c5730bdb: Deleting consensus metadata
I20251211 15:02:21.862151  8110 ts_tablet_manager.cc:1929] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20251211 15:02:21.862228  8110 log.cc:1199] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/wal/wals/b8e66ce2cd364c549facbf026059362c
I20251211 15:02:21.862481  8110 ts_tablet_manager.cc:1950] T b8e66ce2cd364c549facbf026059362c P 61542c6f98af45d08f8b11a9c6a6fb28: Deleting consensus metadata
I20251211 15:02:21.862962  7501 catalog_manager.cc:4985] TS 26c9f4cfbee348308b250097c5730bdb (127.5.160.130:37455): tablet b8e66ce2cd364c549facbf026059362c (table test-table [id=7fffa4a0d67e49f69fd7f15dbd31af93]) successfully deleted
I20251211 15:02:21.863157  7501 catalog_manager.cc:4985] TS 61542c6f98af45d08f8b11a9c6a6fb28 (127.5.160.129:34441): tablet b8e66ce2cd364c549facbf026059362c (table test-table [id=7fffa4a0d67e49f69fd7f15dbd31af93]) successfully deleted
Dec 11 15:02:21 dist-test-slave-4k3m krb5kdc[7467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465341, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM: 
Dec 11 15:02:21 dist-test-slave-4k3m krb5kdc[7467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465341, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:21.882212  8120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:21.873370 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59588 (local address 127.5.160.190:32791)
1211 15:02:21.873650 (+   280us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:21.873654 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:21.873728 (+    74us) server_negotiation.cc:408] Connection header received
1211 15:02:21.873889 (+   161us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:21.873893 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:21.873944 (+    51us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:21.874029 (+    85us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:21.875016 (+   987us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:21.875639 (+   623us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:21.876363 (+   724us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:21.876525 (+   162us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:21.878746 (+  2221us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:21.878771 (+    25us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:21.878774 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:21.878804 (+    30us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:21.880598 (+  1794us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:21.881013 (+   415us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:21.881016 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:21.881018 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:21.881064 (+    46us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:21.881335 (+   271us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:21.881338 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:21.881339 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:21.881616 (+   277us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:21.881739 (+   123us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:21.881953 (+   214us) server_negotiation.cc:300] Negotiation successful
1211 15:02:21.882065 (+   112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":108,"threads_started":1}
I20251211 15:02:21.884871  7514 catalog_manager.cc:2257] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59588:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20251211 15:02:21.885332  7514 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:02:21.890295  7796 tablet_service.cc:1505] Processing CreateTablet for tablet 37dc5d49d23b4877bb04204fcc47d629 (DEFAULT_TABLE table=test-table [id=532eaa18c24e418386b5ed92959b645f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:21.890295  7654 tablet_service.cc:1505] Processing CreateTablet for tablet 37dc5d49d23b4877bb04204fcc47d629 (DEFAULT_TABLE table=test-table [id=532eaa18c24e418386b5ed92959b645f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:21.890457  7938 tablet_service.cc:1505] Processing CreateTablet for tablet 37dc5d49d23b4877bb04204fcc47d629 (DEFAULT_TABLE table=test-table [id=532eaa18c24e418386b5ed92959b645f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:21.890609  7796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37dc5d49d23b4877bb04204fcc47d629. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:21.890609  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37dc5d49d23b4877bb04204fcc47d629. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:21.890739  7938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37dc5d49d23b4877bb04204fcc47d629. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:21.892725  8121 tablet_bootstrap.cc:492] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa: Bootstrap starting.
I20251211 15:02:21.893306  8123 tablet_bootstrap.cc:492] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb: Bootstrap starting.
I20251211 15:02:21.893628  8121 tablet_bootstrap.cc:654] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:21.894109  8123 tablet_bootstrap.cc:654] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:21.894763  8122 tablet_bootstrap.cc:492] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28: Bootstrap starting.
I20251211 15:02:21.894852  8121 tablet_bootstrap.cc:492] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa: No bootstrap required, opened a new log
I20251211 15:02:21.895004  8121 ts_tablet_manager.cc:1403] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:02:21.895387  8121 raft_consensus.cc:359] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:21.895485  8121 raft_consensus.cc:385] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:21.895506  8121 raft_consensus.cc:740] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 702e68d273eb43aca2d07467acadd6fa, State: Initialized, Role: FOLLOWER
I20251211 15:02:21.895541  8122 tablet_bootstrap.cc:654] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:21.895620  8121 consensus_queue.cc:260] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:21.895969  8121 ts_tablet_manager.cc:1434] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20251211 15:02:21.896447  8123 tablet_bootstrap.cc:492] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb: No bootstrap required, opened a new log
I20251211 15:02:21.896543  8123 ts_tablet_manager.cc:1403] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb: Time spent bootstrapping tablet: real 0.003s	user 0.001s	sys 0.000s
I20251211 15:02:21.897089  8123 raft_consensus.cc:359] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:21.897202  8123 raft_consensus.cc:385] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:21.897243  8123 raft_consensus.cc:740] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26c9f4cfbee348308b250097c5730bdb, State: Initialized, Role: FOLLOWER
I20251211 15:02:21.897375  8123 consensus_queue.cc:260] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:21.897730  8123 ts_tablet_manager.cc:1434] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20251211 15:02:21.898146  8122 tablet_bootstrap.cc:492] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28: No bootstrap required, opened a new log
I20251211 15:02:21.898272  8122 ts_tablet_manager.cc:1403] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28: Time spent bootstrapping tablet: real 0.004s	user 0.002s	sys 0.000s
I20251211 15:02:21.898712  8122 raft_consensus.cc:359] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:21.898821  8122 raft_consensus.cc:385] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:21.898876  8122 raft_consensus.cc:740] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61542c6f98af45d08f8b11a9c6a6fb28, State: Initialized, Role: FOLLOWER
I20251211 15:02:21.899039  8122 consensus_queue.cc:260] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:21.899401  8122 ts_tablet_manager.cc:1434] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20251211 15:02:22.124986  8127 raft_consensus.cc:493] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:02:22.125131  8127 raft_consensus.cc:515] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:22.126325  8127 leader_election.cc:290] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61542c6f98af45d08f8b11a9c6a6fb28 (127.5.160.129:34441), 702e68d273eb43aca2d07467acadd6fa (127.5.160.131:46629)
I20251211 15:02:22.129631  8129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:22.126597 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:34441 (local address 127.5.160.130:58327)
1211 15:02:22.126909 (+   312us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:22.126946 (+    37us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:22.127067 (+   121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:22.127392 (+   325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:22.127395 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:22.127423 (+    28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:22.127732 (+   309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:22.127741 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.128580 (+   839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:22.128584 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:22.129297 (+   713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:22.129305 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.129391 (+    86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:22.129411 (+    20us) client_negotiation.cc:769] Sending connection context
1211 15:02:22.129452 (+    41us) client_negotiation.cc:240] Negotiation successful
1211 15:02:22.129498 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":142,"threads_started":1}
I20251211 15:02:22.129890  8131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:22.127048 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:46629 (local address 127.5.160.130:33571)
1211 15:02:22.127273 (+   225us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:22.127285 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:22.127349 (+    64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:22.127633 (+   284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:22.127636 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:22.127654 (+    18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:22.127932 (+   278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:22.127940 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.128874 (+   934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:22.128877 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:22.129532 (+   655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:22.129541 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.129646 (+   105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:22.129664 (+    18us) client_negotiation.cc:769] Sending connection context
1211 15:02:22.129710 (+    46us) client_negotiation.cc:240] Negotiation successful
1211 15:02:22.129762 (+    52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":81,"threads_started":1}
I20251211 15:02:22.130146  8130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:22.126684 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:58327 (local address 127.5.160.129:34441)
1211 15:02:22.127007 (+   323us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:22.127012 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:22.127034 (+    22us) server_negotiation.cc:408] Connection header received
1211 15:02:22.127177 (+   143us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:22.127181 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:22.127233 (+    52us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:22.127353 (+   120us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:22.127843 (+   490us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.128476 (+   633us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:22.129423 (+   947us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.129887 (+   464us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:22.129926 (+    39us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:22.129979 (+    53us) server_negotiation.cc:300] Negotiation successful
1211 15:02:22.130033 (+    54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":91,"threads_started":1}
I20251211 15:02:22.130522  8132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:22.127163 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:33571 (local address 127.5.160.131:46629)
1211 15:02:22.127401 (+   238us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:22.127405 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:22.127418 (+    13us) server_negotiation.cc:408] Connection header received
1211 15:02:22.127468 (+    50us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:22.127470 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:22.127516 (+    46us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:22.127609 (+    93us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:22.128045 (+   436us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.128765 (+   720us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:22.129658 (+   893us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.130261 (+   603us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:22.130302 (+    41us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:22.130349 (+    47us) server_negotiation.cc:300] Negotiation successful
1211 15:02:22.130402 (+    53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":80,"threads_started":1}
I20251211 15:02:22.130569  7674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37dc5d49d23b4877bb04204fcc47d629" candidate_uuid: "26c9f4cfbee348308b250097c5730bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" is_pre_election: true
I20251211 15:02:22.130733  7674 raft_consensus.cc:2468] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26c9f4cfbee348308b250097c5730bdb in term 0.
I20251211 15:02:22.130895  7958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37dc5d49d23b4877bb04204fcc47d629" candidate_uuid: "26c9f4cfbee348308b250097c5730bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "702e68d273eb43aca2d07467acadd6fa" is_pre_election: true
I20251211 15:02:22.131049  7958 raft_consensus.cc:2468] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26c9f4cfbee348308b250097c5730bdb in term 0.
I20251211 15:02:22.131104  7749 leader_election.cc:304] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26c9f4cfbee348308b250097c5730bdb, 61542c6f98af45d08f8b11a9c6a6fb28; no voters: 
I20251211 15:02:22.131325  8127 raft_consensus.cc:2804] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:02:22.131381  8127 raft_consensus.cc:493] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:02:22.131415  8127 raft_consensus.cc:3060] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:22.132289  8127 raft_consensus.cc:515] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:22.132653  8127 leader_election.cc:290] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [CANDIDATE]: Term 1 election: Requested vote from peers 61542c6f98af45d08f8b11a9c6a6fb28 (127.5.160.129:34441), 702e68d273eb43aca2d07467acadd6fa (127.5.160.131:46629)
I20251211 15:02:22.132997  7674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37dc5d49d23b4877bb04204fcc47d629" candidate_uuid: "26c9f4cfbee348308b250097c5730bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61542c6f98af45d08f8b11a9c6a6fb28"
I20251211 15:02:22.133014  7958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37dc5d49d23b4877bb04204fcc47d629" candidate_uuid: "26c9f4cfbee348308b250097c5730bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "702e68d273eb43aca2d07467acadd6fa"
I20251211 15:02:22.133093  7674 raft_consensus.cc:3060] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:22.133106  7958 raft_consensus.cc:3060] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:22.133947  7674 raft_consensus.cc:2468] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26c9f4cfbee348308b250097c5730bdb in term 1.
I20251211 15:02:22.134006  7958 raft_consensus.cc:2468] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26c9f4cfbee348308b250097c5730bdb in term 1.
I20251211 15:02:22.134186  7749 leader_election.cc:304] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26c9f4cfbee348308b250097c5730bdb, 61542c6f98af45d08f8b11a9c6a6fb28; no voters: 
I20251211 15:02:22.134325  8127 raft_consensus.cc:2804] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:22.134507  8127 raft_consensus.cc:697] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [term 1 LEADER]: Becoming Leader. State: Replica: 26c9f4cfbee348308b250097c5730bdb, State: Running, Role: LEADER
I20251211 15:02:22.134737  8127 consensus_queue.cc:237] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:22.137033  7515 catalog_manager.cc:5654] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb reported cstate change: term changed from 0 to 1, leader changed from <none> to 26c9f4cfbee348308b250097c5730bdb (127.5.160.130). New cstate: current_term: 1 leader_uuid: "26c9f4cfbee348308b250097c5730bdb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } health_report { overall_health: UNKNOWN } } }
I20251211 15:02:22.197409  8136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:22.194296 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43860 (local address 127.5.160.130:37455)
1211 15:02:22.194580 (+   284us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:22.194584 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:22.194596 (+    12us) server_negotiation.cc:408] Connection header received
1211 15:02:22.194668 (+    72us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:22.194670 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:22.194729 (+    59us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:22.194819 (+    90us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:02:22.195153 (+   334us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.195667 (+   514us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:22.196292 (+   625us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.196465 (+   173us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:22.196517 (+    52us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:02:22.197012 (+   495us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:02:22.197104 (+    92us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:22.197226 (+   122us) server_negotiation.cc:300] Negotiation successful
1211 15:02:22.197277 (+    51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":126,"threads_started":1}
I20251211 15:02:22.208029  8132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:22.205348 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:38175 (local address 127.5.160.131:46629)
1211 15:02:22.205480 (+   132us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:22.205485 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:22.205503 (+    18us) server_negotiation.cc:408] Connection header received
1211 15:02:22.205645 (+   142us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:22.205648 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:22.205705 (+    57us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:22.205772 (+    67us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:02:22.206202 (+   430us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.206755 (+   553us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:22.207506 (+   751us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.207644 (+   138us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:22.207684 (+    40us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:02:22.207757 (+    73us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:02:22.207818 (+    61us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:22.207881 (+    63us) server_negotiation.cc:300] Negotiation successful
1211 15:02:22.207921 (+    40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20251211 15:02:22.208051  8139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:22.205099 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:46629 (local address 127.5.160.130:38175)
1211 15:02:22.205416 (+   317us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:22.205429 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:22.205557 (+   128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:22.205825 (+   268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:22.205827 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:22.205835 (+     8us) client_negotiation.cc:189] Negotiated authn=TOKEN
1211 15:02:22.206075 (+   240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:22.206081 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.206854 (+   773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:22.206858 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:22.207378 (+   520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:22.207386 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.207485 (+    99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:22.207528 (+    43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
1211 15:02:22.207828 (+   300us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
1211 15:02:22.207831 (+     3us) client_negotiation.cc:769] Sending connection context
1211 15:02:22.207874 (+    43us) client_negotiation.cc:240] Negotiation successful
1211 15:02:22.207934 (+    60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":103,"threads_started":1}
I20251211 15:02:22.213820  7674 raft_consensus.cc:1275] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Refusing update from remote peer 26c9f4cfbee348308b250097c5730bdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:22.213857  7958 raft_consensus.cc:1275] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Refusing update from remote peer 26c9f4cfbee348308b250097c5730bdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:22.214272  8133 consensus_queue.cc:1048] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:22.214435  8127 consensus_queue.cc:1048] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:22.230448  8136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:22.227797 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:43817 (local address 127.5.160.130:37455)
1211 15:02:22.227913 (+   116us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:22.227916 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:22.228099 (+   183us) server_negotiation.cc:408] Connection header received
1211 15:02:22.228213 (+   114us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:22.228216 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:22.228265 (+    49us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:22.228331 (+    66us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:02:22.228701 (+   370us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.229216 (+   515us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:22.229810 (+   594us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.229987 (+   177us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:22.230026 (+    39us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:02:22.230088 (+    62us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:02:22.230147 (+    59us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:22.230256 (+   109us) server_negotiation.cc:300] Negotiation successful
1211 15:02:22.230302 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20251211 15:02:22.230448  8143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:22.227730 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:37455 (local address 127.5.160.131:43817)
1211 15:02:22.228033 (+   303us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:22.228047 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:22.228133 (+    86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:22.228358 (+   225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:22.228361 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:22.228369 (+     8us) client_negotiation.cc:189] Negotiated authn=TOKEN
1211 15:02:22.228598 (+   229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:22.228604 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.229316 (+   712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:22.229319 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:22.229715 (+   396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:22.229721 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:22.229816 (+    95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:22.229844 (+    28us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
1211 15:02:22.230173 (+   329us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
1211 15:02:22.230178 (+     5us) client_negotiation.cc:769] Sending connection context
1211 15:02:22.230244 (+    66us) client_negotiation.cc:240] Negotiation successful
1211 15:02:22.230315 (+    71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":90,"threads_started":1}
I20251211 15:02:22.253854  7515 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59588:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:22.253998  7515 catalog_manager.cc:2755] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59588:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:22.256021  7515 catalog_manager.cc:5941] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273: Sending DeleteTablet for 3 replicas of tablet 37dc5d49d23b4877bb04204fcc47d629
I20251211 15:02:22.256735  7938 tablet_service.cc:1552] Processing DeleteTablet for tablet 37dc5d49d23b4877bb04204fcc47d629 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:22 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:43568
I20251211 15:02:22.256735  7654 tablet_service.cc:1552] Processing DeleteTablet for tablet 37dc5d49d23b4877bb04204fcc47d629 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:22 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:56126
I20251211 15:02:22.256920  8112 tablet_replica.cc:333] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa: stopping tablet replica
I20251211 15:02:22.256920  8110 tablet_replica.cc:333] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28: stopping tablet replica
I20251211 15:02:22.257022  8112 raft_consensus.cc:2243] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:02:22.257022  8110 raft_consensus.cc:2243] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:02:22.257126  8112 raft_consensus.cc:2272] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:22.257126  8110 raft_consensus.cc:2272] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:22.257355  7515 catalog_manager.cc:2257] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59588:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20251211 15:02:22.257792  7796 tablet_service.cc:1552] Processing DeleteTablet for tablet 37dc5d49d23b4877bb04204fcc47d629 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:22 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:43848
W20251211 15:02:22.257910  7515 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:02:22.257958  8111 tablet_replica.cc:333] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb: stopping tablet replica
I20251211 15:02:22.258050  8111 raft_consensus.cc:2243] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [term 1 LEADER]: Raft consensus shutting down.
I20251211 15:02:22.258209  8110 ts_tablet_manager.cc:1916] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:22.258354  8111 raft_consensus.cc:2272] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:22.259173  8111 ts_tablet_manager.cc:1916] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:22.260610  8110 ts_tablet_manager.cc:1929] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20251211 15:02:22.260672  8110 log.cc:1199] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-0/wal/wals/37dc5d49d23b4877bb04204fcc47d629
I20251211 15:02:22.260890  8110 ts_tablet_manager.cc:1950] T 37dc5d49d23b4877bb04204fcc47d629 P 61542c6f98af45d08f8b11a9c6a6fb28: Deleting consensus metadata
I20251211 15:02:22.261363  8111 ts_tablet_manager.cc:1929] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20251211 15:02:22.261421  8111 log.cc:1199] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/wal/wals/37dc5d49d23b4877bb04204fcc47d629
I20251211 15:02:22.261533  7501 catalog_manager.cc:4985] TS 61542c6f98af45d08f8b11a9c6a6fb28 (127.5.160.129:34441): tablet 37dc5d49d23b4877bb04204fcc47d629 (table test-table [id=532eaa18c24e418386b5ed92959b645f]) successfully deleted
I20251211 15:02:22.261634  8111 ts_tablet_manager.cc:1950] T 37dc5d49d23b4877bb04204fcc47d629 P 26c9f4cfbee348308b250097c5730bdb: Deleting consensus metadata
I20251211 15:02:22.262079  8112 ts_tablet_manager.cc:1916] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:22.262564  7501 catalog_manager.cc:4985] TS 26c9f4cfbee348308b250097c5730bdb (127.5.160.130:37455): tablet 37dc5d49d23b4877bb04204fcc47d629 (table test-table [id=532eaa18c24e418386b5ed92959b645f]) successfully deleted
I20251211 15:02:22.264467  8112 ts_tablet_manager.cc:1929] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20251211 15:02:22.264547  8112 log.cc:1199] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/wal/wals/37dc5d49d23b4877bb04204fcc47d629
I20251211 15:02:22.264801  8112 ts_tablet_manager.cc:1950] T 37dc5d49d23b4877bb04204fcc47d629 P 702e68d273eb43aca2d07467acadd6fa: Deleting consensus metadata
I20251211 15:02:22.265148  7654 tablet_service.cc:1505] Processing CreateTablet for tablet faea333f9e0b4c3a93be64197895e53a (DEFAULT_TABLE table=test-table [id=d34db63184184936a3c604ac49a4d7bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:22.265393  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faea333f9e0b4c3a93be64197895e53a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:22.265439  7501 catalog_manager.cc:4985] TS 702e68d273eb43aca2d07467acadd6fa (127.5.160.131:46629): tablet 37dc5d49d23b4877bb04204fcc47d629 (table test-table [id=532eaa18c24e418386b5ed92959b645f]) successfully deleted
I20251211 15:02:22.265779  7796 tablet_service.cc:1505] Processing CreateTablet for tablet faea333f9e0b4c3a93be64197895e53a (DEFAULT_TABLE table=test-table [id=d34db63184184936a3c604ac49a4d7bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:22.265789  7938 tablet_service.cc:1505] Processing CreateTablet for tablet faea333f9e0b4c3a93be64197895e53a (DEFAULT_TABLE table=test-table [id=d34db63184184936a3c604ac49a4d7bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:22.265998  7796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faea333f9e0b4c3a93be64197895e53a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:22.266012  7938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faea333f9e0b4c3a93be64197895e53a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:22.267658  8122 tablet_bootstrap.cc:492] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28: Bootstrap starting.
I20251211 15:02:22.267973  8121 tablet_bootstrap.cc:492] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa: Bootstrap starting.
I20251211 15:02:22.268066  8123 tablet_bootstrap.cc:492] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb: Bootstrap starting.
I20251211 15:02:22.268508  8122 tablet_bootstrap.cc:654] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:22.268767  8121 tablet_bootstrap.cc:654] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:22.268955  8123 tablet_bootstrap.cc:654] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:22.269527  8122 tablet_bootstrap.cc:492] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28: No bootstrap required, opened a new log
I20251211 15:02:22.269610  8122 ts_tablet_manager.cc:1403] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:02:22.269757  8121 tablet_bootstrap.cc:492] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa: No bootstrap required, opened a new log
I20251211 15:02:22.269831  8121 ts_tablet_manager.cc:1403] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.001s
I20251211 15:02:22.270067  8122 raft_consensus.cc:359] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:22.270164  8122 raft_consensus.cc:385] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:22.270196  8122 raft_consensus.cc:740] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61542c6f98af45d08f8b11a9c6a6fb28, State: Initialized, Role: FOLLOWER
I20251211 15:02:22.270200  8121 raft_consensus.cc:359] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:22.270305  8121 raft_consensus.cc:385] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:22.270334  8121 raft_consensus.cc:740] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 702e68d273eb43aca2d07467acadd6fa, State: Initialized, Role: FOLLOWER
I20251211 15:02:22.270342  8122 consensus_queue.cc:260] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:22.270444  8121 consensus_queue.cc:260] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:22.270624  8122 ts_tablet_manager.cc:1434] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20251211 15:02:22.270666  8121 ts_tablet_manager.cc:1434] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20251211 15:02:22.271242  8123 tablet_bootstrap.cc:492] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb: No bootstrap required, opened a new log
I20251211 15:02:22.271315  8123 ts_tablet_manager.cc:1403] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb: Time spent bootstrapping tablet: real 0.003s	user 0.001s	sys 0.000s
I20251211 15:02:22.271747  8123 raft_consensus.cc:359] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:22.271871  8123 raft_consensus.cc:385] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:22.271914  8123 raft_consensus.cc:740] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26c9f4cfbee348308b250097c5730bdb, State: Initialized, Role: FOLLOWER
I20251211 15:02:22.272032  8123 consensus_queue.cc:260] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:22.272277  8123 ts_tablet_manager.cc:1434] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20251211 15:02:22.307219  8133 raft_consensus.cc:493] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:02:22.307374  8133 raft_consensus.cc:515] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:22.307792  8133 leader_election.cc:290] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61542c6f98af45d08f8b11a9c6a6fb28 (127.5.160.129:34441), 702e68d273eb43aca2d07467acadd6fa (127.5.160.131:46629)
I20251211 15:02:22.308175  7958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "faea333f9e0b4c3a93be64197895e53a" candidate_uuid: "26c9f4cfbee348308b250097c5730bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "702e68d273eb43aca2d07467acadd6fa" is_pre_election: true
I20251211 15:02:22.308223  7674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "faea333f9e0b4c3a93be64197895e53a" candidate_uuid: "26c9f4cfbee348308b250097c5730bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" is_pre_election: true
I20251211 15:02:22.308295  7958 raft_consensus.cc:2468] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26c9f4cfbee348308b250097c5730bdb in term 0.
I20251211 15:02:22.308383  7674 raft_consensus.cc:2468] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26c9f4cfbee348308b250097c5730bdb in term 0.
I20251211 15:02:22.308578  7749 leader_election.cc:304] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26c9f4cfbee348308b250097c5730bdb, 702e68d273eb43aca2d07467acadd6fa; no voters: 
I20251211 15:02:22.308723  8133 raft_consensus.cc:2804] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:02:22.308779  8133 raft_consensus.cc:493] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:02:22.308820  8133 raft_consensus.cc:3060] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:22.310112  8133 raft_consensus.cc:515] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:22.310417  8133 leader_election.cc:290] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [CANDIDATE]: Term 1 election: Requested vote from peers 61542c6f98af45d08f8b11a9c6a6fb28 (127.5.160.129:34441), 702e68d273eb43aca2d07467acadd6fa (127.5.160.131:46629)
I20251211 15:02:22.310765  7958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "faea333f9e0b4c3a93be64197895e53a" candidate_uuid: "26c9f4cfbee348308b250097c5730bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "702e68d273eb43aca2d07467acadd6fa"
I20251211 15:02:22.310770  7674 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "faea333f9e0b4c3a93be64197895e53a" candidate_uuid: "26c9f4cfbee348308b250097c5730bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61542c6f98af45d08f8b11a9c6a6fb28"
I20251211 15:02:22.310866  7958 raft_consensus.cc:3060] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:22.310878  7674 raft_consensus.cc:3060] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:22.311724  7958 raft_consensus.cc:2468] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26c9f4cfbee348308b250097c5730bdb in term 1.
I20251211 15:02:22.311939  7674 raft_consensus.cc:2468] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26c9f4cfbee348308b250097c5730bdb in term 1.
I20251211 15:02:22.312026  7749 leader_election.cc:304] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26c9f4cfbee348308b250097c5730bdb, 702e68d273eb43aca2d07467acadd6fa; no voters: 
I20251211 15:02:22.312167  8133 raft_consensus.cc:2804] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:22.312235  8133 raft_consensus.cc:697] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [term 1 LEADER]: Becoming Leader. State: Replica: 26c9f4cfbee348308b250097c5730bdb, State: Running, Role: LEADER
I20251211 15:02:22.312362  8133 consensus_queue.cc:237] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } }
I20251211 15:02:22.314011  7514 catalog_manager.cc:5654] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb reported cstate change: term changed from 0 to 1, leader changed from <none> to 26c9f4cfbee348308b250097c5730bdb (127.5.160.130). New cstate: current_term: 1 leader_uuid: "26c9f4cfbee348308b250097c5730bdb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26c9f4cfbee348308b250097c5730bdb" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 } health_report { overall_health: UNKNOWN } } }
I20251211 15:02:22.333148  7958 raft_consensus.cc:1275] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Refusing update from remote peer 26c9f4cfbee348308b250097c5730bdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:22.333155  7673 raft_consensus.cc:1275] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Refusing update from remote peer 26c9f4cfbee348308b250097c5730bdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:22.333628  8144 consensus_queue.cc:1048] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "702e68d273eb43aca2d07467acadd6fa" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 46629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:22.333815  8133 consensus_queue.cc:1048] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "61542c6f98af45d08f8b11a9c6a6fb28" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251211 15:02:22.348273  8094 tablet_replica.cc:1306] Aborted: operation has been aborted: cancelling pending write operations
I20251211 15:02:23.907073  7515 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59588:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:23.907223  7515 catalog_manager.cc:2755] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59588:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:23.909498  7515 catalog_manager.cc:5941] T 00000000000000000000000000000000 P c2a68018d5714725b8860f727fbb0273: Sending DeleteTablet for 3 replicas of tablet faea333f9e0b4c3a93be64197895e53a
I20251211 15:02:23.910044  7654 tablet_service.cc:1552] Processing DeleteTablet for tablet faea333f9e0b4c3a93be64197895e53a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:23 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:56126
I20251211 15:02:23.910168  7938 tablet_service.cc:1552] Processing DeleteTablet for tablet faea333f9e0b4c3a93be64197895e53a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:23 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:43568
I20251211 15:02:23.910413  8174 tablet_replica.cc:333] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28: stopping tablet replica
I20251211 15:02:23.910571  8174 raft_consensus.cc:2243] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:02:23.910667  7796 tablet_service.cc:1552] Processing DeleteTablet for tablet faea333f9e0b4c3a93be64197895e53a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:23 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:43848
I20251211 15:02:23.910727  8174 raft_consensus.cc:2272] T faea333f9e0b4c3a93be64197895e53a P 61542c6f98af45d08f8b11a9c6a6fb28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:23.910887  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 7589
I20251211 15:02:23.912567  8176 tablet_replica.cc:333] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb: stopping tablet replica
I20251211 15:02:23.912694  8176 raft_consensus.cc:2243] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [term 1 LEADER]: Raft consensus shutting down.
I20251211 15:02:23.912882  8176 raft_consensus.cc:2272] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:23.913415  8176 ts_tablet_manager.cc:1916] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:23.915154  8175 tablet_replica.cc:333] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa: stopping tablet replica
I20251211 15:02:23.915287  8175 raft_consensus.cc:2243] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:02:23.915416  8175 raft_consensus.cc:2272] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:23.915506  8176 ts_tablet_manager.cc:1929] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20251211 15:02:23.915585  8176 log.cc:1199] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-1/wal/wals/faea333f9e0b4c3a93be64197895e53a
I20251211 15:02:23.915871  8176 ts_tablet_manager.cc:1950] T faea333f9e0b4c3a93be64197895e53a P 26c9f4cfbee348308b250097c5730bdb: Deleting consensus metadata
I20251211 15:02:23.916069  8175 ts_tablet_manager.cc:1916] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:23.916564  7501 catalog_manager.cc:4985] TS 26c9f4cfbee348308b250097c5730bdb (127.5.160.130:37455): tablet faea333f9e0b4c3a93be64197895e53a (table test-table [id=d34db63184184936a3c604ac49a4d7bf]) successfully deleted
W20251211 15:02:23.918241  7501 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.160.129:34441 (error 108)
I20251211 15:02:23.918480  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 7731
I20251211 15:02:23.919701  8175 ts_tablet_manager.cc:1929] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20251211 15:02:23.919812  8175 log.cc:1199] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1765465326787564-5762-0/minicluster-data/ts-2/wal/wals/faea333f9e0b4c3a93be64197895e53a
I20251211 15:02:23.919962  8178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:23.919562 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:34441 (local address 127.0.0.1:56148)
1211 15:02:23.919805 (+   243us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:23.919871 (+    66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.129:34441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":77,"threads_started":1}
I20251211 15:02:23.920096  8175 ts_tablet_manager.cc:1950] T faea333f9e0b4c3a93be64197895e53a P 702e68d273eb43aca2d07467acadd6fa: Deleting consensus metadata
W20251211 15:02:23.920289  7501 catalog_manager.cc:4712] TS 61542c6f98af45d08f8b11a9c6a6fb28 (127.5.160.129:34441): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet faea333f9e0b4c3a93be64197895e53a: Network error: Client connection negotiation failed: client connection to 127.5.160.129:34441: connect: Connection refused (error 111)
I20251211 15:02:23.920816  7501 catalog_manager.cc:4985] TS 702e68d273eb43aca2d07467acadd6fa (127.5.160.131:46629): tablet faea333f9e0b4c3a93be64197895e53a (table test-table [id=d34db63184184936a3c604ac49a4d7bf]) successfully deleted
I20251211 15:02:23.925617  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 7873
I20251211 15:02:23.931694  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 7483
2025-12-11T15:02:23Z chronyd exiting
[       OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (7522 ms)
[ RUN      ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:02:23 dist-test-slave-4k3m krb5kdc[8181](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:02:24 dist-test-slave-4k3m krb5kdc[8181](info): set up 2 sockets
Dec 11 15:02:24 dist-test-slave-4k3m krb5kdc[8181](info): commencing operation
krb5kdc: starting...
W20251211 15:02:25.795380  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.841s	user 0.001s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:02:25 dist-test-slave-4k3m krb5kdc[8181](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:02:25Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:02:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:25.929319  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:42995
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:37109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:42995
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:26.036280  8197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:26.036530  8197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:26.036604  8197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:26.039978  8197 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:02:26.040051  8197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:26.040082  8197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:26.040107  8197 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:02:26.040138  8197 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:02:26.044539  8197 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:37109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:42995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:42995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:26.045647  8197 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:26.046486  8197 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:26.053638  8203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:26.053679  8197 server_base.cc:1047] running on GCE node
W20251211 15:02:26.053730  8202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:26.053638  8205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:26.054579  8197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:26.055778  8197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:26.056931  8197 hybrid_clock.cc:648] HybridClock initialized: now 1765465346056908 us; error 43 us; skew 500 ppm
Dec 11 15:02:26 dist-test-slave-4k3m krb5kdc[8181](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465346, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:26.060338  8197 init.cc:377] Logged in from keytab as kudu/127.5.160.190@KRBTEST.COM (short username kudu)
I20251211 15:02:26.061913  8197 webserver.cc:492] Webserver started at http://127.5.160.190:38481/ using document root <none> and password file <none>
I20251211 15:02:26.062635  8197 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:26.062712  8197 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:26.062961  8197 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:26.065373  8197 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "05b2affd949e4ecea44682404fd26957"
format_stamp: "Formatted at 2025-12-11 15:02:26 on dist-test-slave-4k3m"
server_key: "104121467b7e60b9f854a465e121264e"
server_key_iv: "6030f19dfac52ac8716a53979cd68ba8"
server_key_version: "encryptionkey@0"
I20251211 15:02:26.065920  8197 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "05b2affd949e4ecea44682404fd26957"
format_stamp: "Formatted at 2025-12-11 15:02:26 on dist-test-slave-4k3m"
server_key: "104121467b7e60b9f854a465e121264e"
server_key_iv: "6030f19dfac52ac8716a53979cd68ba8"
server_key_version: "encryptionkey@0"
I20251211 15:02:26.070571  8197 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20251211 15:02:26.073719  8212 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:26.075153  8197 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20251211 15:02:26.075398  8197 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "05b2affd949e4ecea44682404fd26957"
format_stamp: "Formatted at 2025-12-11 15:02:26 on dist-test-slave-4k3m"
server_key: "104121467b7e60b9f854a465e121264e"
server_key_iv: "6030f19dfac52ac8716a53979cd68ba8"
server_key_version: "encryptionkey@0"
I20251211 15:02:26.075753  8197 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:26.096539  8197 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:26.099668  8197 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:26.099843  8197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:26.106972  8197 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:42995
I20251211 15:02:26.106990  8264 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:42995 every 8 connection(s)
I20251211 15:02:26.108031  8197 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:02:26.111166  8265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:26.115289  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 8197
I20251211 15:02:26.115401  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:02:26.115622  5762 external_mini_cluster.cc:1468] Setting key 3a6b0b6c51544a93d27e8e4fcb0b0c64
I20251211 15:02:26.117184  8265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957: Bootstrap starting.
I20251211 15:02:26.119407  8265 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:26.120112  8265 log.cc:826] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:26.121970  8265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957: No bootstrap required, opened a new log
Dec 11 15:02:26 dist-test-slave-4k3m krb5kdc[8181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:26.124742  8265 raft_consensus.cc:359] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05b2affd949e4ecea44682404fd26957" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 42995 } }
I20251211 15:02:26.124950  8265 raft_consensus.cc:385] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:26.125018  8265 raft_consensus.cc:740] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b2affd949e4ecea44682404fd26957, State: Initialized, Role: FOLLOWER
I20251211 15:02:26.125443  8265 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05b2affd949e4ecea44682404fd26957" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 42995 } }
I20251211 15:02:26.125574  8265 raft_consensus.cc:399] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:02:26.125634  8265 raft_consensus.cc:493] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:02:26.125720  8265 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:26.126513  8265 raft_consensus.cc:515] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05b2affd949e4ecea44682404fd26957" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 42995 } }
I20251211 15:02:26.126864  8265 leader_election.cc:304] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05b2affd949e4ecea44682404fd26957; no voters: 
I20251211 15:02:26.127211  8265 leader_election.cc:290] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:02:26.127553  8270 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:26.127789  8270 raft_consensus.cc:697] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [term 1 LEADER]: Becoming Leader. State: Replica: 05b2affd949e4ecea44682404fd26957, State: Running, Role: LEADER
I20251211 15:02:26.128078  8270 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05b2affd949e4ecea44682404fd26957" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 42995 } }
I20251211 15:02:26.128353  8265 sys_catalog.cc:565] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:02:26.128355  8268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:26.116858 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37888 (local address 127.5.160.190:42995)
1211 15:02:26.117308 (+   450us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:26.117321 (+    13us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:26.117357 (+    36us) server_negotiation.cc:408] Connection header received
1211 15:02:26.117924 (+   567us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:26.117942 (+    18us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:26.118240 (+   298us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:26.118565 (+   325us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:26.119512 (+   947us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:26.120277 (+   765us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:26.120926 (+   649us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:26.121199 (+   273us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:26.123266 (+  2067us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:26.123286 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:26.123296 (+    10us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:26.123331 (+    35us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:26.125257 (+  1926us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:26.125749 (+   492us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:26.125755 (+     6us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:26.125759 (+     4us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:26.125857 (+    98us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:26.126244 (+   387us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:26.126248 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:26.126250 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:26.126606 (+   356us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:26.126805 (+   199us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:26.127128 (+   323us) server_negotiation.cc:300] Negotiation successful
1211 15:02:26.127572 (+   444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":139,"threads_started":1}
I20251211 15:02:26.129143  8272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05b2affd949e4ecea44682404fd26957. Latest consensus state: current_term: 1 leader_uuid: "05b2affd949e4ecea44682404fd26957" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05b2affd949e4ecea44682404fd26957" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 42995 } } }
I20251211 15:02:26.129238  8272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:26.129611  8274 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:02:26.129791  8271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05b2affd949e4ecea44682404fd26957" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05b2affd949e4ecea44682404fd26957" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 42995 } } }
I20251211 15:02:26.129865  8271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:26.132565  8274 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:02:26.138252  8274 catalog_manager.cc:1357] Generated new cluster ID: 8df7881429c84f9c86e96d5b27cfc940
I20251211 15:02:26.138360  8274 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:02:26.156213  8274 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:02:26.157673  8274 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:02:26.173835  8274 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 05b2affd949e4ecea44682404fd26957: Generated new TSK 0
I20251211 15:02:26.174614  8274 catalog_manager.cc:1524] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:26.229506  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:42995
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:37109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:26.337368  8293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:26.337611  8293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:26.337685  8293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:26.341027  8293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:26.341099  8293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:26.341179  8293 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:02:26.345559  8293 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:37109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:42995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:26.346623  8293 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:26.347465  8293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:26.353977  8298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:26.354050  8293 server_base.cc:1047] running on GCE node
W20251211 15:02:26.353986  8301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:26.354249  8299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:26.354640  8293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:26.355239  8293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:26.356427  8293 hybrid_clock.cc:648] HybridClock initialized: now 1765465346356410 us; error 30 us; skew 500 ppm
Dec 11 15:02:26 dist-test-slave-4k3m krb5kdc[8181](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465346, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:26.358882  8293 init.cc:377] Logged in from keytab as kudu/127.5.160.129@KRBTEST.COM (short username kudu)
I20251211 15:02:26.359961  8293 webserver.cc:492] Webserver started at http://127.5.160.129:33385/ using document root <none> and password file <none>
I20251211 15:02:26.360507  8293 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:26.360556  8293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:26.360728  8293 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:26.362344  8293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "634fc324f1c24c10ac8d4633f8d81568"
format_stamp: "Formatted at 2025-12-11 15:02:26 on dist-test-slave-4k3m"
server_key: "7ac56c66894a1d5792d48338506ec97c"
server_key_iv: "b1bff6edea327aa47b2bc1bd81fcc825"
server_key_version: "encryptionkey@0"
I20251211 15:02:26.362797  8293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "634fc324f1c24c10ac8d4633f8d81568"
format_stamp: "Formatted at 2025-12-11 15:02:26 on dist-test-slave-4k3m"
server_key: "7ac56c66894a1d5792d48338506ec97c"
server_key_iv: "b1bff6edea327aa47b2bc1bd81fcc825"
server_key_version: "encryptionkey@0"
I20251211 15:02:26.366024  8293 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.002s
I20251211 15:02:26.368281  8308 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:26.369253  8293 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:02:26.369355  8293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "634fc324f1c24c10ac8d4633f8d81568"
format_stamp: "Formatted at 2025-12-11 15:02:26 on dist-test-slave-4k3m"
server_key: "7ac56c66894a1d5792d48338506ec97c"
server_key_iv: "b1bff6edea327aa47b2bc1bd81fcc825"
server_key_version: "encryptionkey@0"
I20251211 15:02:26.369477  8293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:26.399385  8293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:26.402415  8293 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:26.402607  8293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:26.403187  8293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:26.404076  8293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:26.404125  8293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:26.404175  8293 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:26.404202  8293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:26.412905  8293 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:45433
I20251211 15:02:26.412941  8421 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:45433 every 8 connection(s)
I20251211 15:02:26.413847  8293 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:02:26.415282  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 8293
I20251211 15:02:26.415457  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:02:26.415729  5762 external_mini_cluster.cc:1468] Setting key 50ef464ca360377db8fea9127a44e356
Dec 11 15:02:26 dist-test-slave-4k3m krb5kdc[8181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465346, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.130@KRBTEST.COM" created.
I20251211 15:02:26.427068  8268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:26.415627 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:55695 (local address 127.5.160.190:42995)
1211 15:02:26.415796 (+   169us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:26.415801 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:26.416482 (+   681us) server_negotiation.cc:408] Connection header received
1211 15:02:26.417467 (+   985us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:26.417471 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:26.417521 (+    50us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:26.417597 (+    76us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:26.419525 (+  1928us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:26.420038 (+   513us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:26.421018 (+   980us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:26.421161 (+   143us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:26.423796 (+  2635us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:26.423816 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:26.423819 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:26.423846 (+    27us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:26.425215 (+  1369us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:26.425751 (+   536us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:26.425754 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:26.425756 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:26.425801 (+    45us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:26.426011 (+   210us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:26.426013 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:26.426014 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:26.426155 (+   141us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:26.426230 (+    75us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:26.426781 (+   551us) server_negotiation.cc:300] Negotiation successful
1211 15:02:26.426891 (+   110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20251211 15:02:26.427713  8424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:26.415896 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:42995 (local address 127.5.160.129:55695)
1211 15:02:26.416350 (+   454us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:26.416391 (+    41us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:26.417271 (+   880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:26.417762 (+   491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:26.417770 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:26.418148 (+   378us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:26.419368 (+  1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:26.419387 (+    19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:26.420160 (+   773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:26.420165 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:26.420893 (+   728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:26.420905 (+    12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:26.421157 (+   252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:26.421839 (+   682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:26.421878 (+    39us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:26.423629 (+  1751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:26.425386 (+  1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:26.425394 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:26.425407 (+    13us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:26.425643 (+   236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:26.425866 (+   223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:26.425869 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:26.425870 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:26.425952 (+    82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:26.426233 (+   281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:26.426239 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:26.426531 (+   292us) client_negotiation.cc:769] Sending connection context
1211 15:02:26.426742 (+   211us) client_negotiation.cc:240] Negotiation successful
1211 15:02:26.427050 (+   308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":104,"threads_started":1}
I20251211 15:02:26.428802  8422 heartbeater.cc:344] Connected to a master server at 127.5.160.190:42995
I20251211 15:02:26.429087  8422 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:26.429612  8422 heartbeater.cc:507] Master 127.5.160.190:42995 requested a full tablet report, sending...
I20251211 15:02:26.431218  8229 ts_manager.cc:194] Registered new tserver with Master: 634fc324f1c24c10ac8d4633f8d81568 (127.5.160.129:45433)
I20251211 15:02:26.432511  8229 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:55695
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:26.462679  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:42995
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:37109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:26.567854  8429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:26.568100  8429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:26.568181  8429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:26.571497  8429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:26.571573  8429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:26.571679  8429 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:02:26.576105  8429 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:37109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:42995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8429
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:26.577206  8429 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:26.578038  8429 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:26.584590  8437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:26.584575  8435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:26.584590  8434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:26.584952  8429 server_base.cc:1047] running on GCE node
I20251211 15:02:26.585327  8429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:26.585880  8429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:26.586978  8429 hybrid_clock.cc:648] HybridClock initialized: now 1765465346586965 us; error 29 us; skew 500 ppm
Dec 11 15:02:26 dist-test-slave-4k3m krb5kdc[8181](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465346, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:26.589654  8429 init.cc:377] Logged in from keytab as kudu/127.5.160.130@KRBTEST.COM (short username kudu)
I20251211 15:02:26.590708  8429 webserver.cc:492] Webserver started at http://127.5.160.130:36241/ using document root <none> and password file <none>
I20251211 15:02:26.591269  8429 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:26.591328  8429 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:26.591521  8429 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:26.593191  8429 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "d00c20528b114ca590b7cad117ecb642"
format_stamp: "Formatted at 2025-12-11 15:02:26 on dist-test-slave-4k3m"
server_key: "39e01e8b06819ce88f9403fda5219473"
server_key_iv: "c914137664fd6daa1b3921a60251ef8f"
server_key_version: "encryptionkey@0"
I20251211 15:02:26.593654  8429 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "d00c20528b114ca590b7cad117ecb642"
format_stamp: "Formatted at 2025-12-11 15:02:26 on dist-test-slave-4k3m"
server_key: "39e01e8b06819ce88f9403fda5219473"
server_key_iv: "c914137664fd6daa1b3921a60251ef8f"
server_key_version: "encryptionkey@0"
I20251211 15:02:26.597046  8429 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20251211 15:02:26.599443  8444 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:26.600469  8429 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:02:26.600570  8429 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "d00c20528b114ca590b7cad117ecb642"
format_stamp: "Formatted at 2025-12-11 15:02:26 on dist-test-slave-4k3m"
server_key: "39e01e8b06819ce88f9403fda5219473"
server_key_iv: "c914137664fd6daa1b3921a60251ef8f"
server_key_version: "encryptionkey@0"
I20251211 15:02:26.600664  8429 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:26.618837  8429 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:26.621618  8429 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:26.621786  8429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:26.622310  8429 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:26.623172  8429 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:26.623221  8429 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:26.623273  8429 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:26.623296  8429 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:26.631870  8429 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:46189
I20251211 15:02:26.631903  8557 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:46189 every 8 connection(s)
I20251211 15:02:26.632819  8429 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:02:26.638338  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 8429
I20251211 15:02:26.638451  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:02:26.638698  5762 external_mini_cluster.cc:1468] Setting key 13ca34a12cabb6c2a5be29d78f0bbe59
Dec 11 15:02:26 dist-test-slave-4k3m krb5kdc[8181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465346, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:26.645030  8268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:26.634524 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:57281 (local address 127.5.160.190:42995)
1211 15:02:26.634663 (+   139us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:26.634668 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:26.635363 (+   695us) server_negotiation.cc:408] Connection header received
1211 15:02:26.636186 (+   823us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:26.636190 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:26.636237 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:26.636310 (+    73us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:26.637915 (+  1605us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:26.638590 (+   675us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:26.639391 (+   801us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:26.639563 (+   172us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:26.641695 (+  2132us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:26.641711 (+    16us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:26.641714 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:26.641739 (+    25us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:26.643140 (+  1401us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:26.643700 (+   560us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:26.643704 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:26.643705 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:26.643751 (+    46us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:26.644015 (+   264us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:26.644019 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:26.644021 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:26.644172 (+   151us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:26.644258 (+    86us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:26.644752 (+   494us) server_negotiation.cc:300] Negotiation successful
1211 15:02:26.644875 (+   123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20251211 15:02:26.645666  8560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:26.634772 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:42995 (local address 127.5.160.130:57281)
1211 15:02:26.635216 (+   444us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:26.635252 (+    36us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:26.636000 (+   748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:26.636462 (+   462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:26.636470 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:26.636875 (+   405us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:26.637771 (+   896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:26.637786 (+    15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:26.638725 (+   939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:26.638728 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:26.639230 (+   502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:26.639240 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:26.639450 (+   210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:26.640018 (+   568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:26.640051 (+    33us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:26.641545 (+  1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:26.643260 (+  1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:26.643267 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:26.643280 (+    13us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:26.643587 (+   307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:26.643830 (+   243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:26.643834 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:26.643836 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:26.643934 (+    98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:26.644268 (+   334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:26.644276 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:26.644512 (+   236us) client_negotiation.cc:769] Sending connection context
1211 15:02:26.644703 (+   191us) client_negotiation.cc:240] Negotiation successful
1211 15:02:26.644966 (+   263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":127,"threads_started":1}
WARNING: no policy specified for kudu/127.5.160.131@KRBTEST.COM; defaulting to no policy
I20251211 15:02:26.646670  8558 heartbeater.cc:344] Connected to a master server at 127.5.160.190:42995
I20251211 15:02:26.646888  8558 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:26.647400  8558 heartbeater.cc:507] Master 127.5.160.190:42995 requested a full tablet report, sending...
I20251211 15:02:26.648351  8229 ts_manager.cc:194] Registered new tserver with Master: d00c20528b114ca590b7cad117ecb642 (127.5.160.130:46189)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.131@KRBTEST.COM" created.
I20251211 15:02:26.648995  8229 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.130@KRBTEST.COM'} at 127.5.160.130:57281
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:26.683986  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:42995
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:37109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:26.793671  8565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:26.793915  8565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:26.793987  8565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:26.797400  8565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:26.797493  8565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:26.797593  8565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:02:26.802057  8565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:37109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:42995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:26.803277  8565 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:26.804163  8565 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:26.811285  8570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:26.811367  8573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:26.811442  8571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:26.811579  8565 server_base.cc:1047] running on GCE node
I20251211 15:02:26.811968  8565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:26.812551  8565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:26.813723  8565 hybrid_clock.cc:648] HybridClock initialized: now 1765465346813697 us; error 39 us; skew 500 ppm
Dec 11 15:02:26 dist-test-slave-4k3m krb5kdc[8181](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465346, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:26.816659  8565 init.cc:377] Logged in from keytab as kudu/127.5.160.131@KRBTEST.COM (short username kudu)
I20251211 15:02:26.817807  8565 webserver.cc:492] Webserver started at http://127.5.160.131:35511/ using document root <none> and password file <none>
I20251211 15:02:26.818343  8565 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:26.818392  8565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:26.818562  8565 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:26.820333  8565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "e39d161d8d94469e95e332354e0ed32c"
format_stamp: "Formatted at 2025-12-11 15:02:26 on dist-test-slave-4k3m"
server_key: "40333f54cb78b677036984d8aed699a5"
server_key_iv: "894c3980bac9f64bfb7f3886f889d163"
server_key_version: "encryptionkey@0"
I20251211 15:02:26.820788  8565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "e39d161d8d94469e95e332354e0ed32c"
format_stamp: "Formatted at 2025-12-11 15:02:26 on dist-test-slave-4k3m"
server_key: "40333f54cb78b677036984d8aed699a5"
server_key_iv: "894c3980bac9f64bfb7f3886f889d163"
server_key_version: "encryptionkey@0"
I20251211 15:02:26.824149  8565 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20251211 15:02:26.826473  8580 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:26.827606  8565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20251211 15:02:26.827713  8565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "e39d161d8d94469e95e332354e0ed32c"
format_stamp: "Formatted at 2025-12-11 15:02:26 on dist-test-slave-4k3m"
server_key: "40333f54cb78b677036984d8aed699a5"
server_key_iv: "894c3980bac9f64bfb7f3886f889d163"
server_key_version: "encryptionkey@0"
I20251211 15:02:26.827814  8565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:26.845636  8565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:26.848635  8565 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:26.848834  8565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:26.849433  8565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:26.850373  8565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:26.850425  8565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:26.850473  8565 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:26.850507  8565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:26.859965  8565 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:44639
I20251211 15:02:26.859994  8693 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:44639 every 8 connection(s)
I20251211 15:02:26.860937  8565 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
Dec 11 15:02:26 dist-test-slave-4k3m krb5kdc[8181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465346, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:26.869724  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 8565
I20251211 15:02:26.869827  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:02:26.870378  5762 external_mini_cluster.cc:1468] Setting key 6a19157ee1529c5d2943aef284fcb38f
I20251211 15:02:26.873159  8268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:26.862728 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:50457 (local address 127.5.160.190:42995)
1211 15:02:26.862873 (+   145us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:26.862878 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:26.863579 (+   701us) server_negotiation.cc:408] Connection header received
1211 15:02:26.864357 (+   778us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:26.864361 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:26.864412 (+    51us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:26.864488 (+    76us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:26.866069 (+  1581us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:26.866598 (+   529us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:26.867221 (+   623us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:26.867396 (+   175us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:26.869624 (+  2228us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:26.869644 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:26.869646 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:26.869673 (+    27us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:26.871193 (+  1520us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:26.871773 (+   580us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:26.871777 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:26.871778 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:26.871823 (+    45us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:26.872096 (+   273us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:26.872100 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:26.872101 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:26.872262 (+   161us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:26.872344 (+    82us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:26.872883 (+   539us) server_negotiation.cc:300] Negotiation successful
1211 15:02:26.873003 (+   120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20251211 15:02:26.873907  8696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:26.863014 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:42995 (local address 127.5.160.131:50457)
1211 15:02:26.863439 (+   425us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:26.863474 (+    35us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:26.864164 (+   690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:26.864626 (+   462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:26.864633 (+     7us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:26.865007 (+   374us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:26.865922 (+   915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:26.865936 (+    14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:26.866694 (+   758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:26.866696 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:26.867134 (+   438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:26.867141 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:26.867365 (+   224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:26.867949 (+   584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:26.867972 (+    23us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:26.869433 (+  1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:26.871302 (+  1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:26.871309 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:26.871322 (+    13us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:26.871674 (+   352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:26.871911 (+   237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:26.871915 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:26.871916 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:26.872012 (+    96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:26.872409 (+   397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:26.872415 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:26.872652 (+   237us) client_negotiation.cc:769] Sending connection context
1211 15:02:26.872836 (+   184us) client_negotiation.cc:240] Negotiation successful
1211 15:02:26.873121 (+   285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":115,"threads_started":1}
I20251211 15:02:26.874889  8694 heartbeater.cc:344] Connected to a master server at 127.5.160.190:42995
I20251211 15:02:26.875139  8694 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:26.875687  8694 heartbeater.cc:507] Master 127.5.160.190:42995 requested a full tablet report, sending...
I20251211 15:02:26.876698  8229 ts_manager.cc:194] Registered new tserver with Master: e39d161d8d94469e95e332354e0ed32c (127.5.160.131:44639)
I20251211 15:02:26.877250  8229 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.131@KRBTEST.COM'} at 127.5.160.131:50457
I20251211 15:02:26.884130  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
W20251211 15:02:26.894825  8268 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:02:26.893593 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37902 (local address 127.5.160.190:42995)
1211 15:02:26.893753 (+   160us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:26.893758 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:26.893774 (+    16us) server_negotiation.cc:408] Connection header received
1211 15:02:26.893895 (+   121us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:26.893898 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:26.893946 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:26.894014 (+    68us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:26.894698 (+   684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37902: BlockingRecv error: recv got EOF from 127.0.0.1:37902 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20251211 15:02:26.896035  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 8293
I20251211 15:02:26.901163  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 8429
I20251211 15:02:26.905920  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 8565
I20251211 15:02:26.910394  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 8197
2025-12-11T15:02:26Z chronyd exiting
[       OK ] SecurityITest.TestNoKerberosCredentials (2976 ms)
[ RUN      ] SecurityITest.TestRebalanceReportUnauthorized
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:02:26 dist-test-slave-4k3m krb5kdc[8706](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:02:26 dist-test-slave-4k3m krb5kdc[8706](info): set up 2 sockets
Dec 11 15:02:26 dist-test-slave-4k3m krb5kdc[8706](info): commencing operation
krb5kdc: starting...
W20251211 15:02:28.747334  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.816s	user 0.003s	sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20251211 15:02:28.931308  5762 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.109s	user 0.000s	sys 0.001s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20251211 15:02:29.100265  5762 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.169s	user 0.000s	sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/test-user.keytab.
W20251211 15:02:30.165401  5762 mini_kdc.cc:290] Time spent creating keytab for test-user: real 1.065s	user 0.000s	sys 0.001s
Dec 11 15:02:30 dist-test-slave-4k3m krb5kdc[8706](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465350, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:02:30Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:02:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
W20251211 15:02:31.062045  5762 mini_kdc.cc:268] Time spent creating service keytab for kudu/127.5.160.190: real 0.876s	user 0.000s	sys 0.003s
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
W20251211 15:02:32.647303  5762 mini_kdc.cc:268] Time spent creating service keytab for HTTP/127.5.160.190: real 1.585s	user 0.000s	sys 0.003s
I20251211 15:02:32.647888  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40407
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:38605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:40407
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:32.763188  8722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:32.763453  8722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:32.763527  8722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:32.766875  8722 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:02:32.766984  8722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:32.767019  8722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:32.767045  8722 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:02:32.767072  8722 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:02:32.771588  8722 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:38605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:40407
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40407
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:32.772756  8722 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:32.773638  8722 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:32.779692  8728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:32.779806  8722 server_base.cc:1047] running on GCE node
W20251211 15:02:32.779700  8730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:32.779706  8727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:32.780460  8722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:32.781448  8722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:32.782599  8722 hybrid_clock.cc:648] HybridClock initialized: now 1765465352782584 us; error 36 us; skew 500 ppm
Dec 11 15:02:32 dist-test-slave-4k3m krb5kdc[8706](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465352, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:32.785223  8722 init.cc:377] Logged in from keytab as kudu/127.5.160.190@KRBTEST.COM (short username kudu)
I20251211 15:02:32.786362  8722 webserver.cc:492] Webserver started at http://127.5.160.190:41031/ using document root <none> and password file <none>
I20251211 15:02:32.786988  8722 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:32.787045  8722 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:32.787235  8722 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:32.789021  8722 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "fbf2833a2b97488b974096a6c5485468"
format_stamp: "Formatted at 2025-12-11 15:02:32 on dist-test-slave-4k3m"
server_key: "8af782c8ef2a342591f302f2397c4f43"
server_key_iv: "194f216ee820e304f502ca2228374faf"
server_key_version: "encryptionkey@0"
I20251211 15:02:32.789506  8722 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "fbf2833a2b97488b974096a6c5485468"
format_stamp: "Formatted at 2025-12-11 15:02:32 on dist-test-slave-4k3m"
server_key: "8af782c8ef2a342591f302f2397c4f43"
server_key_iv: "194f216ee820e304f502ca2228374faf"
server_key_version: "encryptionkey@0"
I20251211 15:02:32.793159  8722 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20251211 15:02:32.795620  8737 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:32.796816  8722 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:02:32.796936  8722 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "fbf2833a2b97488b974096a6c5485468"
format_stamp: "Formatted at 2025-12-11 15:02:32 on dist-test-slave-4k3m"
server_key: "8af782c8ef2a342591f302f2397c4f43"
server_key_iv: "194f216ee820e304f502ca2228374faf"
server_key_version: "encryptionkey@0"
I20251211 15:02:32.797035  8722 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:32.809587  8722 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:32.812820  8722 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:32.813012  8722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:32.820538  8789 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:40407 every 8 connection(s)
I20251211 15:02:32.820534  8722 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:40407
I20251211 15:02:32.821745  8722 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:02:32.823514  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 8722
I20251211 15:02:32.823640  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:02:32.823851  5762 external_mini_cluster.cc:1468] Setting key a0dda8e2c5001e0fbbd928d813566569
I20251211 15:02:32.825012  8790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:32.831454  8790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468: Bootstrap starting.
Dec 11 15:02:32 dist-test-slave-4k3m krb5kdc[8706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465350, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:32.834070  8790 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:32.835067  8790 log.cc:826] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:32.837487  8790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468: No bootstrap required, opened a new log
I20251211 15:02:32.838435  8793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:32.825169 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45336 (local address 127.5.160.190:40407)
1211 15:02:32.825652 (+   483us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:32.825664 (+    12us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:32.825706 (+    42us) server_negotiation.cc:408] Connection header received
1211 15:02:32.827110 (+  1404us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:32.827137 (+    27us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:32.827566 (+   429us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:32.827973 (+   407us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:32.828795 (+   822us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:32.829896 (+  1101us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:32.830610 (+   714us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:32.830913 (+   303us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:32.833247 (+  2334us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:32.833298 (+    51us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:32.833332 (+    34us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:32.833382 (+    50us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:32.835454 (+  2072us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:32.836000 (+   546us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:32.836007 (+     7us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:32.836013 (+     6us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:32.836118 (+   105us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:32.836395 (+   277us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:32.836398 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:32.836400 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:32.836840 (+   440us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:32.837051 (+   211us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:32.837351 (+   300us) server_negotiation.cc:300] Negotiation successful
1211 15:02:32.837636 (+   285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":134,"threads_started":1}
I20251211 15:02:32.840929  8790 raft_consensus.cc:359] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbf2833a2b97488b974096a6c5485468" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40407 } }
I20251211 15:02:32.841135  8790 raft_consensus.cc:385] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:32.841169  8790 raft_consensus.cc:740] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbf2833a2b97488b974096a6c5485468, State: Initialized, Role: FOLLOWER
I20251211 15:02:32.841566  8790 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbf2833a2b97488b974096a6c5485468" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40407 } }
I20251211 15:02:32.841696  8790 raft_consensus.cc:399] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:02:32.841733  8790 raft_consensus.cc:493] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:02:32.841813  8790 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:32.842672  8790 raft_consensus.cc:515] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbf2833a2b97488b974096a6c5485468" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40407 } }
I20251211 15:02:32.843051  8790 leader_election.cc:304] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbf2833a2b97488b974096a6c5485468; no voters: 
I20251211 15:02:32.843335  8790 leader_election.cc:290] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:02:32.843478  8795 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:32.843683  8795 raft_consensus.cc:697] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [term 1 LEADER]: Becoming Leader. State: Replica: fbf2833a2b97488b974096a6c5485468, State: Running, Role: LEADER
I20251211 15:02:32.844009  8795 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbf2833a2b97488b974096a6c5485468" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40407 } }
I20251211 15:02:32.844497  8790 sys_catalog.cc:565] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:02:32.846047  8796 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbf2833a2b97488b974096a6c5485468" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbf2833a2b97488b974096a6c5485468" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40407 } } }
I20251211 15:02:32.846191  8796 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:32.846431  8797 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbf2833a2b97488b974096a6c5485468. Latest consensus state: current_term: 1 leader_uuid: "fbf2833a2b97488b974096a6c5485468" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbf2833a2b97488b974096a6c5485468" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40407 } } }
I20251211 15:02:32.846546  8797 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:32.847200  8802 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:02:32.850486  8802 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:02:32.856515  8802 catalog_manager.cc:1357] Generated new cluster ID: d29417e11d864f9998cc3a083f07dabd
I20251211 15:02:32.856632  8802 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:02:32.877943  8802 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:02:32.879359  8802 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:02:32.888046  8802 catalog_manager.cc:6027] T 00000000000000000000000000000000 P fbf2833a2b97488b974096a6c5485468: Generated new TSK 0
I20251211 15:02:32.888887  8802 catalog_manager.cc:1524] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:32.945506  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40407
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:38605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:33.053258  8818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:33.053498  8818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:33.053566  8818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:33.056948  8818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:33.057018  8818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:33.057101  8818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:02:33.061628  8818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:38605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:40407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:33.062911  8818 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:33.063791  8818 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:33.070475  8824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:33.070513  8823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:33.070619  8818 server_base.cc:1047] running on GCE node
W20251211 15:02:33.070488  8826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:33.071090  8818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:33.071609  8818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:33.072757  8818 hybrid_clock.cc:648] HybridClock initialized: now 1765465353072746 us; error 27 us; skew 500 ppm
Dec 11 15:02:33 dist-test-slave-4k3m krb5kdc[8706](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465353, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:33.075484  8818 init.cc:377] Logged in from keytab as kudu/127.5.160.129@KRBTEST.COM (short username kudu)
I20251211 15:02:33.076581  8818 webserver.cc:492] Webserver started at http://127.5.160.129:45313/ using document root <none> and password file <none>
I20251211 15:02:33.077113  8818 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:33.077162  8818 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:33.077338  8818 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:33.079087  8818 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "938cd1895cd5469cbe246937214cedbf"
format_stamp: "Formatted at 2025-12-11 15:02:33 on dist-test-slave-4k3m"
server_key: "3262410f68cff2b7c1f6cfc78e77cff7"
server_key_iv: "ec9fc1a45662be668ba3768c28ccd00c"
server_key_version: "encryptionkey@0"
I20251211 15:02:33.079545  8818 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "938cd1895cd5469cbe246937214cedbf"
format_stamp: "Formatted at 2025-12-11 15:02:33 on dist-test-slave-4k3m"
server_key: "3262410f68cff2b7c1f6cfc78e77cff7"
server_key_iv: "ec9fc1a45662be668ba3768c28ccd00c"
server_key_version: "encryptionkey@0"
I20251211 15:02:33.082973  8818 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20251211 15:02:33.085228  8833 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:33.086339  8818 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:02:33.086452  8818 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "938cd1895cd5469cbe246937214cedbf"
format_stamp: "Formatted at 2025-12-11 15:02:33 on dist-test-slave-4k3m"
server_key: "3262410f68cff2b7c1f6cfc78e77cff7"
server_key_iv: "ec9fc1a45662be668ba3768c28ccd00c"
server_key_version: "encryptionkey@0"
I20251211 15:02:33.086555  8818 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:33.100545  8818 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:33.103569  8818 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:33.103747  8818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:33.104301  8818 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:33.105258  8818 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:33.105309  8818 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:33.105362  8818 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:33.105391  8818 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:33.114408  8818 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:42029
I20251211 15:02:33.114437  8946 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:42029 every 8 connection(s)
I20251211 15:02:33.115439  8818 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:02:33.121279  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 8818
I20251211 15:02:33.121403  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:02:33.121631  5762 external_mini_cluster.cc:1468] Setting key 18486b2542e5d89debdce5eda45de5dd
Dec 11 15:02:33 dist-test-slave-4k3m krb5kdc[8706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465353, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:33.128556  8793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:33.117275 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:35411 (local address 127.5.160.190:40407)
1211 15:02:33.117425 (+   150us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:33.117429 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:33.118160 (+   731us) server_negotiation.cc:408] Connection header received
1211 15:02:33.119054 (+   894us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:33.119058 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:33.119115 (+    57us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:33.119192 (+    77us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:33.120873 (+  1681us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:33.121452 (+   579us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:33.122293 (+   841us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:33.122462 (+   169us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:33.124742 (+  2280us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:33.124761 (+    19us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:33.124764 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:33.124791 (+    27us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:33.126401 (+  1610us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:33.127052 (+   651us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:33.127056 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:33.127057 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:33.127106 (+    49us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:33.127435 (+   329us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:33.127437 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:33.127438 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:33.127614 (+   176us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:33.127687 (+    73us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:33.128301 (+   614us) server_negotiation.cc:300] Negotiation successful
1211 15:02:33.128406 (+   105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20251211 15:02:33.129439  8949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:33.117522 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40407 (local address 127.5.160.129:35411)
1211 15:02:33.117999 (+   477us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:33.118038 (+    39us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:33.118832 (+   794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:33.119382 (+   550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:33.119391 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:33.119810 (+   419us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:33.120717 (+   907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:33.120731 (+    14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:33.121572 (+   841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:33.121576 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:33.122023 (+   447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:33.122033 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:33.122231 (+   198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:33.122875 (+   644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:33.122909 (+    34us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:33.124575 (+  1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:33.126527 (+  1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:33.126533 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:33.126547 (+    14us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:33.126949 (+   402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:33.127191 (+   242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:33.127195 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:33.127197 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:33.127341 (+   144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:33.127711 (+   370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:33.127719 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:33.128044 (+   325us) client_negotiation.cc:769] Sending connection context
1211 15:02:33.128279 (+   235us) client_negotiation.cc:240] Negotiation successful
1211 15:02:33.128583 (+   304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":115,"threads_started":1}
WARNING: no policy specified for kudu/127.5.160.130@KRBTEST.COM; defaulting to no policy
I20251211 15:02:33.130633  8947 heartbeater.cc:344] Connected to a master server at 127.5.160.190:40407
I20251211 15:02:33.130869  8947 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:33.131461  8947 heartbeater.cc:507] Master 127.5.160.190:40407 requested a full tablet report, sending...
I20251211 15:02:33.133108  8754 ts_manager.cc:194] Registered new tserver with Master: 938cd1895cd5469cbe246937214cedbf (127.5.160.129:42029)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.130@KRBTEST.COM" created.
I20251211 15:02:33.134609  8754 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:35411
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:33.170078  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40407
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:38605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:33.275655  8954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:33.275869  8954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:33.275933  8954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:33.279314  8954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:33.279386  8954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:33.279476  8954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:02:33.283936  8954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:38605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:40407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:33.285045  8954 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:33.285892  8954 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:33.292585  8959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:33.292642  8962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:33.292599  8960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:33.292752  8954 server_base.cc:1047] running on GCE node
I20251211 15:02:33.293272  8954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:33.293830  8954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:33.295044  8954 hybrid_clock.cc:648] HybridClock initialized: now 1765465353295019 us; error 38 us; skew 500 ppm
Dec 11 15:02:33 dist-test-slave-4k3m krb5kdc[8706](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465353, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:33.297614  8954 init.cc:377] Logged in from keytab as kudu/127.5.160.130@KRBTEST.COM (short username kudu)
I20251211 15:02:33.298687  8954 webserver.cc:492] Webserver started at http://127.5.160.130:46603/ using document root <none> and password file <none>
I20251211 15:02:33.299263  8954 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:33.299314  8954 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:33.299480  8954 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:33.301175  8954 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "55129150a94d45aeb45222c3c6b9ab80"
format_stamp: "Formatted at 2025-12-11 15:02:33 on dist-test-slave-4k3m"
server_key: "fe99c517c2eb1910cdec80cd2a3a927b"
server_key_iv: "520d4d1451312adcbf2976af3e443705"
server_key_version: "encryptionkey@0"
I20251211 15:02:33.301648  8954 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "55129150a94d45aeb45222c3c6b9ab80"
format_stamp: "Formatted at 2025-12-11 15:02:33 on dist-test-slave-4k3m"
server_key: "fe99c517c2eb1910cdec80cd2a3a927b"
server_key_iv: "520d4d1451312adcbf2976af3e443705"
server_key_version: "encryptionkey@0"
I20251211 15:02:33.305150  8954 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20251211 15:02:33.307619  8969 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:33.308816  8954 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20251211 15:02:33.308944  8954 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "55129150a94d45aeb45222c3c6b9ab80"
format_stamp: "Formatted at 2025-12-11 15:02:33 on dist-test-slave-4k3m"
server_key: "fe99c517c2eb1910cdec80cd2a3a927b"
server_key_iv: "520d4d1451312adcbf2976af3e443705"
server_key_version: "encryptionkey@0"
I20251211 15:02:33.309064  8954 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:33.321285  8954 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:33.324257  8954 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:33.324427  8954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:33.324970  8954 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:33.325893  8954 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:33.325939  8954 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:33.325981  8954 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:33.326009  8954 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:33.334656  8954 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:43815
I20251211 15:02:33.334669  9082 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:43815 every 8 connection(s)
I20251211 15:02:33.335704  8954 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
Dec 11 15:02:33 dist-test-slave-4k3m krb5kdc[8706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465353, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:33.345954  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 8954
I20251211 15:02:33.346052  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:02:33.346262  5762 external_mini_cluster.cc:1468] Setting key d4b3ef3de8c1333ae7c6aae70010b851
I20251211 15:02:33.348253  8793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:33.337451 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:47637 (local address 127.5.160.190:40407)
1211 15:02:33.337578 (+   127us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:33.337582 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:33.338301 (+   719us) server_negotiation.cc:408] Connection header received
1211 15:02:33.339204 (+   903us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:33.339208 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:33.339266 (+    58us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:33.339337 (+    71us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:33.340985 (+  1648us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:33.341488 (+   503us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:33.342132 (+   644us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:33.342318 (+   186us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:33.344615 (+  2297us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:33.344639 (+    24us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:33.344641 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:33.344670 (+    29us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:33.346030 (+  1360us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:33.346571 (+   541us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:33.346575 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:33.346576 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:33.346646 (+    70us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:33.347046 (+   400us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:33.347049 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:33.347050 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:33.347228 (+   178us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:33.347317 (+    89us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:33.347964 (+   647us) server_negotiation.cc:300] Negotiation successful
1211 15:02:33.348105 (+   141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20251211 15:02:33.348848  9085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:33.337701 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40407 (local address 127.5.160.130:47637)
1211 15:02:33.338159 (+   458us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:33.338195 (+    36us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:33.339014 (+   819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:33.339505 (+   491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:33.339513 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:33.339912 (+   399us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:33.340821 (+   909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:33.340835 (+    14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:33.341614 (+   779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:33.341617 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:33.342017 (+   400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:33.342024 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:33.342254 (+   230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:33.342885 (+   631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:33.342912 (+    27us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:33.344441 (+  1529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:33.346168 (+  1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:33.346174 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:33.346184 (+    10us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:33.346471 (+   287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:33.346754 (+   283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:33.346758 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:33.346760 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:33.346880 (+   120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:33.347373 (+   493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:33.347380 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:33.347683 (+   303us) client_negotiation.cc:769] Sending connection context
1211 15:02:33.347869 (+   186us) client_negotiation.cc:240] Negotiation successful
1211 15:02:33.348104 (+   235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":129,"threads_started":1}
I20251211 15:02:33.349925  9083 heartbeater.cc:344] Connected to a master server at 127.5.160.190:40407
I20251211 15:02:33.350179  9083 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:33.350704  9083 heartbeater.cc:507] Master 127.5.160.190:40407 requested a full tablet report, sending...
I20251211 15:02:33.351858  8754 ts_manager.cc:194] Registered new tserver with Master: 55129150a94d45aeb45222c3c6b9ab80 (127.5.160.130:43815)
I20251211 15:02:33.352505  8754 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.130@KRBTEST.COM'} at 127.5.160.130:47637
WARNING: no policy specified for kudu/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:33.392378  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40407
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:38605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:33.499909  9090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:33.500138  9090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:33.500229  9090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:33.503671  9090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:33.503748  9090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:33.503857  9090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:02:33.508271  9090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:38605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:40407
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:33.509541  9090 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:33.510473  9090 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:33.517241  9095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:33.517241  9096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:33.517556  9090 server_base.cc:1047] running on GCE node
W20251211 15:02:33.517647  9098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:33.517979  9090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:33.518525  9090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:33.519661  9090 hybrid_clock.cc:648] HybridClock initialized: now 1765465353519642 us; error 35 us; skew 500 ppm
Dec 11 15:02:33 dist-test-slave-4k3m krb5kdc[8706](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465353, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:33.522209  9090 init.cc:377] Logged in from keytab as kudu/127.5.160.131@KRBTEST.COM (short username kudu)
I20251211 15:02:33.523394  9090 webserver.cc:492] Webserver started at http://127.5.160.131:42625/ using document root <none> and password file <none>
I20251211 15:02:33.523933  9090 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:33.523980  9090 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:33.524171  9090 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:33.525871  9090 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "78c84731389c4966913c045e8d238626"
format_stamp: "Formatted at 2025-12-11 15:02:33 on dist-test-slave-4k3m"
server_key: "5c1451ac3e79eb11730baa4c9ef94568"
server_key_iv: "c83e8c081fdd832d6fc5234f0a6a12ad"
server_key_version: "encryptionkey@0"
I20251211 15:02:33.526327  9090 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "78c84731389c4966913c045e8d238626"
format_stamp: "Formatted at 2025-12-11 15:02:33 on dist-test-slave-4k3m"
server_key: "5c1451ac3e79eb11730baa4c9ef94568"
server_key_iv: "c83e8c081fdd832d6fc5234f0a6a12ad"
server_key_version: "encryptionkey@0"
I20251211 15:02:33.529649  9090 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20251211 15:02:33.531786  9105 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:33.532721  9090 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:02:33.532816  9090 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "78c84731389c4966913c045e8d238626"
format_stamp: "Formatted at 2025-12-11 15:02:33 on dist-test-slave-4k3m"
server_key: "5c1451ac3e79eb11730baa4c9ef94568"
server_key_iv: "c83e8c081fdd832d6fc5234f0a6a12ad"
server_key_version: "encryptionkey@0"
I20251211 15:02:33.532907  9090 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:33.547478  9090 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:33.550503  9090 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:33.550668  9090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:33.551213  9090 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:33.552054  9090 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:33.552101  9090 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:33.552139  9090 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:33.552152  9090 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:33.560966  9090 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:36855
I20251211 15:02:33.560981  9218 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:36855 every 8 connection(s)
I20251211 15:02:33.561952  9090 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
I20251211 15:02:33.568217  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 9090
I20251211 15:02:33.568358  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRebalanceReportUnauthorized.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:02:33.568630  5762 external_mini_cluster.cc:1468] Setting key 763e7b861453c13b59218066b4d36f42
Dec 11 15:02:33 dist-test-slave-4k3m krb5kdc[8706](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465353, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:33.574527  8793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:33.563684 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:40271 (local address 127.5.160.190:40407)
1211 15:02:33.563820 (+   136us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:33.563823 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:33.564479 (+   656us) server_negotiation.cc:408] Connection header received
1211 15:02:33.565335 (+   856us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:33.565339 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:33.565419 (+    80us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:33.565491 (+    72us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:33.567218 (+  1727us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:33.567726 (+   508us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:33.568550 (+   824us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:33.568747 (+   197us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:33.571210 (+  2463us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:33.571226 (+    16us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:33.571228 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:33.571316 (+    88us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:33.572612 (+  1296us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:33.573105 (+   493us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:33.573109 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:33.573110 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:33.573154 (+    44us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:33.573438 (+   284us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:33.573441 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:33.573443 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:33.573608 (+   165us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:33.573694 (+    86us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:33.574200 (+   506us) server_negotiation.cc:300] Negotiation successful
1211 15:02:33.574363 (+   163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20251211 15:02:33.575181  9221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:33.563914 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40407 (local address 127.5.160.131:40271)
1211 15:02:33.564337 (+   423us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:33.564376 (+    39us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:33.565132 (+   756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:33.565674 (+   542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:33.565682 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:33.566087 (+   405us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:33.567056 (+   969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:33.567073 (+    17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:33.567849 (+   776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:33.567853 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:33.568398 (+   545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:33.568408 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:33.568669 (+   261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:33.569365 (+   696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:33.569394 (+    29us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:33.571050 (+  1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:33.572747 (+  1697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:33.572754 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:33.572768 (+    14us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:33.573011 (+   243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:33.573235 (+   224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:33.573237 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:33.573239 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:33.573354 (+   115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:33.573705 (+   351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:33.573713 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:33.573959 (+   246us) client_negotiation.cc:769] Sending connection context
1211 15:02:33.574157 (+   198us) client_negotiation.cc:240] Negotiation successful
1211 15:02:33.574444 (+   287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":110,"threads_started":1}
I20251211 15:02:33.576251  9219 heartbeater.cc:344] Connected to a master server at 127.5.160.190:40407
I20251211 15:02:33.576538  9219 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:33.577075  9219 heartbeater.cc:507] Master 127.5.160.190:40407 requested a full tablet report, sending...
I20251211 15:02:33.578114  8754 ts_manager.cc:194] Registered new tserver with Master: 78c84731389c4966913c045e8d238626 (127.5.160.131:36855)
I20251211 15:02:33.578684  8754 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.131@KRBTEST.COM'} at 127.5.160.131:40271
I20251211 15:02:33.583017  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
W20251211 15:02:33.717865  8793 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:02:33.714079 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45352 (local address 127.5.160.190:40407)
1211 15:02:33.714221 (+   142us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:33.714226 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:33.715307 (+  1081us) server_negotiation.cc:408] Connection header received
1211 15:02:33.716281 (+   974us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:33.716285 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:33.716348 (+    63us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:33.716436 (+    88us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:33.717736 (+  1300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45352: BlockingRecv error: recv got EOF from 127.0.0.1:45352 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20251211 15:02:33.719465  8793 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:02:33.718557 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45364 (local address 127.5.160.190:40407)
1211 15:02:33.718669 (+   112us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:33.718672 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:33.718715 (+    43us) server_negotiation.cc:408] Connection header received
1211 15:02:33.718811 (+    96us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:33.718814 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:33.718850 (+    36us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:33.718916 (+    66us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:33.719382 (+   466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45364: BlockingRecv error: recv got EOF from 127.0.0.1:45364 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20251211 15:02:33.720495  8793 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:02:33.719768 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45374 (local address 127.5.160.190:40407)
1211 15:02:33.719874 (+   106us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:33.719878 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:33.719890 (+    12us) server_negotiation.cc:408] Connection header received
1211 15:02:33.719980 (+    90us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:33.719984 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:33.720020 (+    36us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:33.720078 (+    58us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:33.720409 (+   331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45374: BlockingRecv error: recv got EOF from 127.0.0.1:45374 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20251211 15:02:33.724586  8793 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:02:33.723845 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45384 (local address 127.5.160.190:40407)
1211 15:02:33.723954 (+   109us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:33.723957 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:33.723969 (+    12us) server_negotiation.cc:408] Connection header received
1211 15:02:33.724000 (+    31us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:33.724002 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:33.724035 (+    33us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:33.724096 (+    61us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:33.724513 (+   417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45384: BlockingRecv error: recv got EOF from 127.0.0.1:45384 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20251211 15:02:33.782454  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 8818
I20251211 15:02:33.787469  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 8954
I20251211 15:02:33.792378  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 9090
I20251211 15:02:33.797394  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 8722
2025-12-11T15:02:33Z chronyd exiting
[       OK ] SecurityITest.TestRebalanceReportUnauthorized (6887 ms)
[ RUN      ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:02:33 dist-test-slave-4k3m krb5kdc[9242](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:02:33 dist-test-slave-4k3m krb5kdc[9242](info): set up 2 sockets
Dec 11 15:02:33 dist-test-slave-4k3m krb5kdc[9242](info): commencing operation
krb5kdc: starting...
W20251211 15:02:35.647205  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.829s	user 0.001s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:02:35 dist-test-slave-4k3m krb5kdc[9242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465355, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:02:35Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:02:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:35.785805  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:44273
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:45827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:44273
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:35.890607  9258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:35.890841  9258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:35.890916  9258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:35.894228  9258 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:02:35.894305  9258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:35.894336  9258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:35.894361  9258 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:02:35.894389  9258 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:02:35.898741  9258 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:45827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:44273
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:44273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:35.899886  9258 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:35.900724  9258 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:35.906322  9263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:35.906322  9266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:35.906325  9264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:35.906618  9258 server_base.cc:1047] running on GCE node
I20251211 15:02:35.907187  9258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:35.908131  9258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:35.909312  9258 hybrid_clock.cc:648] HybridClock initialized: now 1765465355909304 us; error 50 us; skew 500 ppm
Dec 11 15:02:35 dist-test-slave-4k3m krb5kdc[9242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465355, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:35.911944  9258 init.cc:377] Logged in from keytab as kudu/127.5.160.190@KRBTEST.COM (short username kudu)
I20251211 15:02:35.913000  9258 webserver.cc:492] Webserver started at http://127.5.160.190:34135/ using document root <none> and password file <none>
I20251211 15:02:35.913554  9258 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:35.913604  9258 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:35.913779  9258 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:35.915473  9258 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "4b5eb856d5e244649d115c8dfd94e059"
format_stamp: "Formatted at 2025-12-11 15:02:35 on dist-test-slave-4k3m"
server_key: "745cbead36f1beb4ec8590ff1a1c34ea"
server_key_iv: "83a302790dcb11b643c894da2ef48548"
server_key_version: "encryptionkey@0"
I20251211 15:02:35.915958  9258 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "4b5eb856d5e244649d115c8dfd94e059"
format_stamp: "Formatted at 2025-12-11 15:02:35 on dist-test-slave-4k3m"
server_key: "745cbead36f1beb4ec8590ff1a1c34ea"
server_key_iv: "83a302790dcb11b643c894da2ef48548"
server_key_version: "encryptionkey@0"
I20251211 15:02:35.919346  9258 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20251211 15:02:35.921609  9273 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:35.922598  9258 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:02:35.922704  9258 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "4b5eb856d5e244649d115c8dfd94e059"
format_stamp: "Formatted at 2025-12-11 15:02:35 on dist-test-slave-4k3m"
server_key: "745cbead36f1beb4ec8590ff1a1c34ea"
server_key_iv: "83a302790dcb11b643c894da2ef48548"
server_key_version: "encryptionkey@0"
I20251211 15:02:35.922793  9258 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:35.946714  9258 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:35.949680  9258 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:35.949856  9258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:35.957129  9258 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:44273
I20251211 15:02:35.957129  9325 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:44273 every 8 connection(s)
I20251211 15:02:35.958181  9258 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:02:35.960906  9326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:35.961685  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 9258
I20251211 15:02:35.961796  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:02:35.962049  5762 external_mini_cluster.cc:1468] Setting key 5e7694871cdb949ec6afbad530361ec0
I20251211 15:02:35.967015  9326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059: Bootstrap starting.
Dec 11 15:02:35 dist-test-slave-4k3m krb5kdc[9242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465355, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:35.969322  9326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:35.970001  9326 log.cc:826] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:35.971930  9326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059: No bootstrap required, opened a new log
I20251211 15:02:35.973968  9329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:35.963312 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34760 (local address 127.5.160.190:44273)
1211 15:02:35.963722 (+   410us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:35.963735 (+    13us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:35.963767 (+    32us) server_negotiation.cc:408] Connection header received
1211 15:02:35.964340 (+   573us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:35.964359 (+    19us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:35.964654 (+   295us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:35.964948 (+   294us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:35.965825 (+   877us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:35.966568 (+   743us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:35.967255 (+   687us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:35.967520 (+   265us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:35.969818 (+  2298us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:35.969834 (+    16us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:35.969845 (+    11us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:35.969879 (+    34us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:35.971603 (+  1724us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:35.971993 (+   390us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:35.971997 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:35.972001 (+     4us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:35.972091 (+    90us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:35.972338 (+   247us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:35.972341 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:35.972342 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:35.972686 (+   344us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:35.972876 (+   190us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:35.973139 (+   263us) server_negotiation.cc:300] Negotiation successful
1211 15:02:35.973386 (+   247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":128,"threads_started":1}
I20251211 15:02:35.974469  9326 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b5eb856d5e244649d115c8dfd94e059" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44273 } }
I20251211 15:02:35.974654  9326 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:35.974733  9326 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5eb856d5e244649d115c8dfd94e059, State: Initialized, Role: FOLLOWER
I20251211 15:02:35.975224  9326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b5eb856d5e244649d115c8dfd94e059" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44273 } }
I20251211 15:02:35.975373  9326 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:02:35.975433  9326 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:02:35.975517  9326 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:35.976459  9326 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b5eb856d5e244649d115c8dfd94e059" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44273 } }
I20251211 15:02:35.976835  5762 external_mini_cluster.cc:949] 0 TS(s) registered with all masters
I20251211 15:02:35.976814  9326 leader_election.cc:304] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b5eb856d5e244649d115c8dfd94e059; no voters: 
I20251211 15:02:35.977109  9326 leader_election.cc:290] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:02:35.977226  9331 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:35.977502  9331 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [term 1 LEADER]: Becoming Leader. State: Replica: 4b5eb856d5e244649d115c8dfd94e059, State: Running, Role: LEADER
I20251211 15:02:35.977792  9331 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b5eb856d5e244649d115c8dfd94e059" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44273 } }
I20251211 15:02:35.978262  9326 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:02:35.978893  9331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b5eb856d5e244649d115c8dfd94e059. Latest consensus state: current_term: 1 leader_uuid: "4b5eb856d5e244649d115c8dfd94e059" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b5eb856d5e244649d115c8dfd94e059" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44273 } } }
I20251211 15:02:35.979128  9331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:35.979240  9332 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b5eb856d5e244649d115c8dfd94e059" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b5eb856d5e244649d115c8dfd94e059" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44273 } } }
I20251211 15:02:35.979334  9332 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:35.980149  9336 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:02:35.983271  9336 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:02:35.988600  9336 catalog_manager.cc:1357] Generated new cluster ID: 7c8724e5b0fe424f9c125998bae71ac5
I20251211 15:02:35.988674  9336 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:02:35.999338  9329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:35.994417 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34776 (local address 127.5.160.190:44273)
1211 15:02:35.994553 (+   136us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:35.994558 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:35.994903 (+   345us) server_negotiation.cc:408] Connection header received
1211 15:02:35.995048 (+   145us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:35.995052 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:35.995120 (+    68us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:35.995210 (+    90us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:35.995963 (+   753us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:35.996732 (+   769us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:35.997536 (+   804us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:35.998112 (+   576us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:35.998241 (+   129us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:35.998263 (+    22us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:35.998266 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:02:35.998845 (+   579us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:35.998885 (+    40us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:02:35.998905 (+    20us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:35.999025 (+   120us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:35.999110 (+    85us) server_negotiation.cc:300] Negotiation successful
1211 15:02:35.999176 (+    66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20251211 15:02:36.004954  9336 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:02:36.006027  9336 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:02:36.018797  9336 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 4b5eb856d5e244649d115c8dfd94e059: Generated new TSK 0
I20251211 15:02:36.019632  9336 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 15:02:36.025061  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 9258
2025-12-11T15:02:36Z chronyd exiting
[       OK ] SecurityITest.SaslPlainFallback (2226 ms)
[ RUN      ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:02:36 dist-test-slave-4k3m krb5kdc[9359](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:02:36 dist-test-slave-4k3m krb5kdc[9359](info): set up 2 sockets
Dec 11 15:02:36 dist-test-slave-4k3m krb5kdc[9359](info): commencing operation
krb5kdc: starting...
W20251211 15:02:37.871349  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.827s	user 0.004s	sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:02:37 dist-test-slave-4k3m krb5kdc[9359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:02:37Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:02:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:38.010864  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:45739
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:44233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:45739
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:38.116251  9375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:38.116521  9375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:38.116598  9375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:38.120029  9375 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:02:38.120103  9375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:38.120133  9375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:38.120160  9375 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:02:38.120191  9375 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:02:38.124755  9375 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:44233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:45739
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:45739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:38.125918  9375 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:38.126767  9375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:38.132448  9383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:38.132468  9380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:38.132618  9375 server_base.cc:1047] running on GCE node
W20251211 15:02:38.132728  9381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:38.133204  9375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:38.134111  9375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:38.135308  9375 hybrid_clock.cc:648] HybridClock initialized: now 1765465358135291 us; error 31 us; skew 500 ppm
Dec 11 15:02:38 dist-test-slave-4k3m krb5kdc[9359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465358, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:38.137883  9375 init.cc:377] Logged in from keytab as kudu/127.5.160.190@KRBTEST.COM (short username kudu)
I20251211 15:02:38.138985  9375 webserver.cc:492] Webserver started at http://127.5.160.190:42793/ using document root <none> and password file <none>
I20251211 15:02:38.139526  9375 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:38.139580  9375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:38.139751  9375 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:38.141407  9375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "781134f7a0694aa786124766ddd5f426"
format_stamp: "Formatted at 2025-12-11 15:02:38 on dist-test-slave-4k3m"
server_key: "935bf2eef19b22f65776868ab8a724e7"
server_key_iv: "ecd6b6d8a02ab7df2097c7bcc5f7b165"
server_key_version: "encryptionkey@0"
I20251211 15:02:38.141877  9375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "781134f7a0694aa786124766ddd5f426"
format_stamp: "Formatted at 2025-12-11 15:02:38 on dist-test-slave-4k3m"
server_key: "935bf2eef19b22f65776868ab8a724e7"
server_key_iv: "ecd6b6d8a02ab7df2097c7bcc5f7b165"
server_key_version: "encryptionkey@0"
I20251211 15:02:38.145313  9375 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.004s
I20251211 15:02:38.147527  9390 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:38.148571  9375 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:02:38.148676  9375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "781134f7a0694aa786124766ddd5f426"
format_stamp: "Formatted at 2025-12-11 15:02:38 on dist-test-slave-4k3m"
server_key: "935bf2eef19b22f65776868ab8a724e7"
server_key_iv: "ecd6b6d8a02ab7df2097c7bcc5f7b165"
server_key_version: "encryptionkey@0"
I20251211 15:02:38.148767  9375 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:38.169292  9375 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:38.176844  9375 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:38.177043  9375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:38.184286  9442 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:45739 every 8 connection(s)
I20251211 15:02:38.184329  9375 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:45739
I20251211 15:02:38.185335  9375 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:02:38.186630  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 9375
I20251211 15:02:38.186759  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:02:38.187036  5762 external_mini_cluster.cc:1468] Setting key b971d8c4dbb108dc7d5caca0928d0ecd
I20251211 15:02:38.189368  9443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Dec 11 15:02:38 dist-test-slave-4k3m krb5kdc[9359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:38.194510  9443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426: Bootstrap starting.
I20251211 15:02:38.196766  9443 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:38.197582  9443 log.cc:826] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:38.199307  9446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:38.188249 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35724 (local address 127.5.160.190:45739)
1211 15:02:38.188654 (+   405us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:38.188664 (+    10us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:38.188698 (+    34us) server_negotiation.cc:408] Connection header received
1211 15:02:38.189399 (+   701us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:38.189417 (+    18us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:38.189745 (+   328us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:38.190090 (+   345us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:38.191074 (+   984us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:38.191830 (+   756us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:38.192454 (+   624us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:38.192740 (+   286us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:38.194806 (+  2066us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:38.194853 (+    47us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:38.194864 (+    11us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:38.194899 (+    35us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:38.196563 (+  1664us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:38.196957 (+   394us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:38.196963 (+     6us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:38.196969 (+     6us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:38.197071 (+   102us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:38.197364 (+   293us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:38.197368 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:38.197370 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:38.197803 (+   433us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:38.197996 (+   193us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:38.198321 (+   325us) server_negotiation.cc:300] Negotiation successful
1211 15:02:38.198599 (+   278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":98,"threads_started":1}
I20251211 15:02:38.199616  9443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426: No bootstrap required, opened a new log
I20251211 15:02:38.202468  9443 raft_consensus.cc:359] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "781134f7a0694aa786124766ddd5f426" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 45739 } }
I20251211 15:02:38.202670  9443 raft_consensus.cc:385] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:38.202729  9443 raft_consensus.cc:740] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 781134f7a0694aa786124766ddd5f426, State: Initialized, Role: FOLLOWER
I20251211 15:02:38.203159  9443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "781134f7a0694aa786124766ddd5f426" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 45739 } }
I20251211 15:02:38.203289  9443 raft_consensus.cc:399] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:02:38.203346  9443 raft_consensus.cc:493] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:02:38.203435  9443 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:38.204285  9443 raft_consensus.cc:515] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "781134f7a0694aa786124766ddd5f426" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 45739 } }
I20251211 15:02:38.204618  9443 leader_election.cc:304] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 781134f7a0694aa786124766ddd5f426; no voters: 
I20251211 15:02:38.204912  9443 leader_election.cc:290] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:02:38.205052  9448 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:38.205293  9448 raft_consensus.cc:697] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [term 1 LEADER]: Becoming Leader. State: Replica: 781134f7a0694aa786124766ddd5f426, State: Running, Role: LEADER
I20251211 15:02:38.205574  9448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "781134f7a0694aa786124766ddd5f426" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 45739 } }
I20251211 15:02:38.206001  9443 sys_catalog.cc:565] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:02:38.207158  9450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 781134f7a0694aa786124766ddd5f426. Latest consensus state: current_term: 1 leader_uuid: "781134f7a0694aa786124766ddd5f426" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "781134f7a0694aa786124766ddd5f426" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 45739 } } }
I20251211 15:02:38.207274  9450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:38.207587  9449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "781134f7a0694aa786124766ddd5f426" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "781134f7a0694aa786124766ddd5f426" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 45739 } } }
I20251211 15:02:38.207660  9457 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:02:38.207726  9449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:38.210337  9457 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:02:38.216292  9457 catalog_manager.cc:1357] Generated new cluster ID: bd411844bf69401792d5795be17259b2
I20251211 15:02:38.216377  9457 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:02:38.227373  9457 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:02:38.228582  9457 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:02:38.236515  9457 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 781134f7a0694aa786124766ddd5f426: Generated new TSK 0
I20251211 15:02:38.237408  9457 catalog_manager.cc:1524] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:38.295884  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:45739
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:44233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:38.431864  9471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:38.432090  9471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:38.432148  9471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:38.435492  9471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:38.435560  9471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:38.435639  9471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:02:38.440030  9471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:44233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:45739
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:38.441043  9471 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:38.441838  9471 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:38.448447  9476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:38.448447  9479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:38.448499  9477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:38.448529  9471 server_base.cc:1047] running on GCE node
I20251211 15:02:38.449072  9471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:38.449590  9471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:38.450740  9471 hybrid_clock.cc:648] HybridClock initialized: now 1765465358450726 us; error 27 us; skew 500 ppm
Dec 11 15:02:38 dist-test-slave-4k3m krb5kdc[9359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465358, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:38.453394  9471 init.cc:377] Logged in from keytab as kudu/127.5.160.129@KRBTEST.COM (short username kudu)
I20251211 15:02:38.454421  9471 webserver.cc:492] Webserver started at http://127.5.160.129:35701/ using document root <none> and password file <none>
I20251211 15:02:38.454995  9471 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:38.455055  9471 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:38.455241  9471 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:38.456907  9471 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "8d1a937a3475485e87c8a2c0de8b7807"
format_stamp: "Formatted at 2025-12-11 15:02:38 on dist-test-slave-4k3m"
server_key: "a5573085ccc1015b79c0484587578f5d"
server_key_iv: "ba5f0931dd78249e8f47d96cb1379138"
server_key_version: "encryptionkey@0"
I20251211 15:02:38.457355  9471 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "8d1a937a3475485e87c8a2c0de8b7807"
format_stamp: "Formatted at 2025-12-11 15:02:38 on dist-test-slave-4k3m"
server_key: "a5573085ccc1015b79c0484587578f5d"
server_key_iv: "ba5f0931dd78249e8f47d96cb1379138"
server_key_version: "encryptionkey@0"
I20251211 15:02:38.460659  9471 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20251211 15:02:38.462800  9486 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:38.463881  9471 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:02:38.464000  9471 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "8d1a937a3475485e87c8a2c0de8b7807"
format_stamp: "Formatted at 2025-12-11 15:02:38 on dist-test-slave-4k3m"
server_key: "a5573085ccc1015b79c0484587578f5d"
server_key_iv: "ba5f0931dd78249e8f47d96cb1379138"
server_key_version: "encryptionkey@0"
I20251211 15:02:38.464088  9471 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:38.481272  9471 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:38.484422  9471 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:38.484622  9471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:38.485261  9471 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:38.486172  9471 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:38.486229  9471 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:38.486284  9471 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:38.486310  9471 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:38.495424  9471 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:46663
I20251211 15:02:38.495503  9599 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:46663 every 8 connection(s)
I20251211 15:02:38.496419  9471 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:02:38.502687  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 9471
I20251211 15:02:38.502821  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:02:38.503106  5762 external_mini_cluster.cc:1468] Setting key 8f7d1aafe6eb2b7153ea626fad7da577
Dec 11 15:02:38 dist-test-slave-4k3m krb5kdc[9359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465358, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:38.509501  9446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:38.498172 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:51099 (local address 127.5.160.190:45739)
1211 15:02:38.498338 (+   166us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:38.498342 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:38.499058 (+   716us) server_negotiation.cc:408] Connection header received
1211 15:02:38.499910 (+   852us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:38.499913 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:38.499964 (+    51us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:38.500038 (+    74us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:38.501716 (+  1678us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:38.502272 (+   556us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:38.503115 (+   843us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:38.503324 (+   209us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:38.505639 (+  2315us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:38.505661 (+    22us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:38.505664 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:38.505697 (+    33us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:38.507143 (+  1446us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:38.507795 (+   652us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:38.507798 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:38.507800 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:38.507850 (+    50us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:38.508233 (+   383us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:38.508237 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:38.508238 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:38.508405 (+   167us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:38.508500 (+    95us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:38.509189 (+   689us) server_negotiation.cc:300] Negotiation successful
1211 15:02:38.509370 (+   181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20251211 15:02:38.510362  9602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:38.498451 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:45739 (local address 127.5.160.129:51099)
1211 15:02:38.498896 (+   445us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:38.498964 (+    68us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:38.499728 (+   764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:38.500180 (+   452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:38.500188 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:38.500616 (+   428us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:38.501563 (+   947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:38.501578 (+    15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:38.502422 (+   844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:38.502426 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:38.502993 (+   567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:38.503004 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:38.503263 (+   259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:38.503981 (+   718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:38.504006 (+    25us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:38.505477 (+  1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:38.507260 (+  1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:38.507267 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:38.507280 (+    13us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:38.507689 (+   409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:38.507940 (+   251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:38.507944 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:38.507946 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:38.508088 (+   142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:38.508516 (+   428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:38.508524 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:38.508864 (+   340us) client_negotiation.cc:769] Sending connection context
1211 15:02:38.509132 (+   268us) client_negotiation.cc:240] Negotiation successful
1211 15:02:38.509460 (+   328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":89,"threads_started":1}
I20251211 15:02:38.511592  9600 heartbeater.cc:344] Connected to a master server at 127.5.160.190:45739
I20251211 15:02:38.511844  9600 heartbeater.cc:461] Registering TS with master...
WARNING: no policy specified for kudu/127.5.160.130@KRBTEST.COM; defaulting to no policy
I20251211 15:02:38.512413  9600 heartbeater.cc:507] Master 127.5.160.190:45739 requested a full tablet report, sending...
I20251211 15:02:38.513916  9407 ts_manager.cc:194] Registered new tserver with Master: 8d1a937a3475485e87c8a2c0de8b7807 (127.5.160.129:46663)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.130@KRBTEST.COM" created.
I20251211 15:02:38.515286  9407 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:51099
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:38.548413  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:45739
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:44233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:38.655881  9607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:38.656211  9607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:38.656360  9607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:38.660470  9607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:38.660544  9607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:38.660624  9607 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:02:38.664916  9607 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:44233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:45739
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:38.665923  9607 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:38.666699  9607 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:38.673415  9615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:38.673415  9612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:38.673416  9613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:38.673506  9607 server_base.cc:1047] running on GCE node
I20251211 15:02:38.674002  9607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:38.674566  9607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:38.675719  9607 hybrid_clock.cc:648] HybridClock initialized: now 1765465358675695 us; error 40 us; skew 500 ppm
Dec 11 15:02:38 dist-test-slave-4k3m krb5kdc[9359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465358, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:38.678381  9607 init.cc:377] Logged in from keytab as kudu/127.5.160.130@KRBTEST.COM (short username kudu)
I20251211 15:02:38.679517  9607 webserver.cc:492] Webserver started at http://127.5.160.130:43873/ using document root <none> and password file <none>
I20251211 15:02:38.680047  9607 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:38.680096  9607 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:38.680279  9607 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:38.681957  9607 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "be41fdeaadf64ab1817698b58e4677f1"
format_stamp: "Formatted at 2025-12-11 15:02:38 on dist-test-slave-4k3m"
server_key: "41ed171ac0dcc5fcdc11bca392f021a0"
server_key_iv: "1f0a9c1919effb3253866742f96c8576"
server_key_version: "encryptionkey@0"
I20251211 15:02:38.682416  9607 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "be41fdeaadf64ab1817698b58e4677f1"
format_stamp: "Formatted at 2025-12-11 15:02:38 on dist-test-slave-4k3m"
server_key: "41ed171ac0dcc5fcdc11bca392f021a0"
server_key_iv: "1f0a9c1919effb3253866742f96c8576"
server_key_version: "encryptionkey@0"
I20251211 15:02:38.685752  9607 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20251211 15:02:38.687911  9622 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:38.688921  9607 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:02:38.689026  9607 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "be41fdeaadf64ab1817698b58e4677f1"
format_stamp: "Formatted at 2025-12-11 15:02:38 on dist-test-slave-4k3m"
server_key: "41ed171ac0dcc5fcdc11bca392f021a0"
server_key_iv: "1f0a9c1919effb3253866742f96c8576"
server_key_version: "encryptionkey@0"
I20251211 15:02:38.689119  9607 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:38.734762  9607 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:38.737828  9607 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:38.738011  9607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:38.738643  9607 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:38.739614  9607 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:38.739665  9607 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:38.739718  9607 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:38.739743  9607 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:38.748639  9607 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:44375
I20251211 15:02:38.748708  9735 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:44375 every 8 connection(s)
I20251211 15:02:38.749608  9607 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:02:38.754312  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 9607
I20251211 15:02:38.754436  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:02:38.754649  5762 external_mini_cluster.cc:1468] Setting key 6bc73d30eaf6efd6f63b9689b8da0b8a
Dec 11 15:02:38 dist-test-slave-4k3m krb5kdc[9359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465358, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.160.131@KRBTEST.COM; defaulting to no policy
I20251211 15:02:38.763329  9446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:38.751566 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:41927 (local address 127.5.160.190:45739)
1211 15:02:38.751729 (+   163us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:38.751734 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:38.752466 (+   732us) server_negotiation.cc:408] Connection header received
1211 15:02:38.753568 (+  1102us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:38.753572 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:38.753632 (+    60us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:38.753706 (+    74us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:38.755564 (+  1858us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:38.756120 (+   556us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:38.756742 (+   622us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:38.756924 (+   182us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:38.759534 (+  2610us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:38.759553 (+    19us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:38.759556 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:38.759584 (+    28us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:38.761140 (+  1556us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:38.761740 (+   600us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:38.761743 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:38.761744 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:38.761783 (+    39us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:38.762099 (+   316us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:38.762101 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:38.762102 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:38.762254 (+   152us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:38.762331 (+    77us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:38.763059 (+   728us) server_negotiation.cc:300] Negotiation successful
1211 15:02:38.763171 (+   112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20251211 15:02:38.764096  9738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:38.751830 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:45739 (local address 127.5.160.130:41927)
1211 15:02:38.752312 (+   482us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:38.752356 (+    44us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:38.753354 (+   998us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:38.753904 (+   550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:38.753913 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:38.754308 (+   395us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:38.755409 (+  1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:38.755427 (+    18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:38.756238 (+   811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:38.756242 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:38.756634 (+   392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:38.756642 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:38.756852 (+   210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:38.757535 (+   683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:38.757572 (+    37us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:38.759343 (+  1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:38.761270 (+  1927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:38.761277 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:38.761290 (+    13us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:38.761647 (+   357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:38.761868 (+   221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:38.761871 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:38.761873 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:38.762008 (+   135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:38.762358 (+   350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:38.762366 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:38.762747 (+   381us) client_negotiation.cc:769] Sending connection context
1211 15:02:38.763026 (+   279us) client_negotiation.cc:240] Negotiation successful
1211 15:02:38.763331 (+   305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":90,"threads_started":1}
I20251211 15:02:38.765194  9736 heartbeater.cc:344] Connected to a master server at 127.5.160.190:45739
I20251211 15:02:38.765467  9736 heartbeater.cc:461] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.131@KRBTEST.COM" created.
I20251211 15:02:38.766077  9736 heartbeater.cc:507] Master 127.5.160.190:45739 requested a full tablet report, sending...
I20251211 15:02:38.767349  9407 ts_manager.cc:194] Registered new tserver with Master: be41fdeaadf64ab1817698b58e4677f1 (127.5.160.130:44375)
I20251211 15:02:38.767927  9407 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.130@KRBTEST.COM'} at 127.5.160.130:41927
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:38.801709  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:45739
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:44233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:38.906697  9743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:38.906956  9743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:38.907035  9743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:38.910439  9743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:38.910511  9743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:38.910616  9743 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:02:38.914899  9743 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:44233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:45739
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:38.915993  9743 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:38.916822  9743 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:38.923417  9749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:38.923419  9751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:38.923537  9743 server_base.cc:1047] running on GCE node
W20251211 15:02:38.923594  9748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:38.924100  9743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:38.924651  9743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:38.925824  9743 hybrid_clock.cc:648] HybridClock initialized: now 1765465358925803 us; error 37 us; skew 500 ppm
Dec 11 15:02:38 dist-test-slave-4k3m krb5kdc[9359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465358, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:38.928800  9743 init.cc:377] Logged in from keytab as kudu/127.5.160.131@KRBTEST.COM (short username kudu)
I20251211 15:02:38.929951  9743 webserver.cc:492] Webserver started at http://127.5.160.131:45893/ using document root <none> and password file <none>
I20251211 15:02:38.930567  9743 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:38.930621  9743 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:38.930795  9743 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:38.932578  9743 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "76479cf72e784e5894bd15de2a3596cb"
format_stamp: "Formatted at 2025-12-11 15:02:38 on dist-test-slave-4k3m"
server_key: "7059ccb837d3dcb5a27fa7bde271d43a"
server_key_iv: "09508753021c6b98e7810221f96b15d3"
server_key_version: "encryptionkey@0"
I20251211 15:02:38.933040  9743 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "76479cf72e784e5894bd15de2a3596cb"
format_stamp: "Formatted at 2025-12-11 15:02:38 on dist-test-slave-4k3m"
server_key: "7059ccb837d3dcb5a27fa7bde271d43a"
server_key_iv: "09508753021c6b98e7810221f96b15d3"
server_key_version: "encryptionkey@0"
I20251211 15:02:38.936400  9743 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.005s
I20251211 15:02:38.938756  9758 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:38.939857  9743 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20251211 15:02:38.939962  9743 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "76479cf72e784e5894bd15de2a3596cb"
format_stamp: "Formatted at 2025-12-11 15:02:38 on dist-test-slave-4k3m"
server_key: "7059ccb837d3dcb5a27fa7bde271d43a"
server_key_iv: "09508753021c6b98e7810221f96b15d3"
server_key_version: "encryptionkey@0"
I20251211 15:02:38.940050  9743 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:38.952332  9743 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:38.955101  9743 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:38.955281  9743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:38.955808  9743 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:38.956724  9743 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:38.956780  9743 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:38.956836  9743 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:38.956862  9743 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:38.965473  9743 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:41269
I20251211 15:02:38.965523  9871 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:41269 every 8 connection(s)
I20251211 15:02:38.966388  9743 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
I20251211 15:02:38.967342  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 9743
I20251211 15:02:38.967459  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:02:38.967710  5762 external_mini_cluster.cc:1468] Setting key 5a73e6921df9f69f88558d97c85bfe10
Dec 11 15:02:38 dist-test-slave-4k3m krb5kdc[9359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465358, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:38.978425  9446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:38.968416 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:55369 (local address 127.5.160.190:45739)
1211 15:02:38.968593 (+   177us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:38.968598 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:38.969190 (+   592us) server_negotiation.cc:408] Connection header received
1211 15:02:38.970179 (+   989us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:38.970181 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:38.970225 (+    44us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:38.970311 (+    86us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:38.972104 (+  1793us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:38.972615 (+   511us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:38.973232 (+   617us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:38.973368 (+   136us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:38.975487 (+  2119us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:38.975506 (+    19us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:38.975509 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:38.975534 (+    25us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:38.976703 (+  1169us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:38.977150 (+   447us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:38.977152 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:38.977154 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:38.977190 (+    36us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:38.977441 (+   251us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:38.977443 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:38.977445 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:38.977586 (+   141us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:38.977657 (+    71us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:38.978166 (+   509us) server_negotiation.cc:300] Negotiation successful
1211 15:02:38.978295 (+   129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20251211 15:02:38.979158  9874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:38.968609 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:45739 (local address 127.5.160.131:55369)
1211 15:02:38.969054 (+   445us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:38.969089 (+    35us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:38.969993 (+   904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:38.970456 (+   463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:38.970464 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:38.971027 (+   563us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:38.971978 (+   951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:38.971992 (+    14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:38.972734 (+   742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:38.972738 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:38.973137 (+   399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:38.973145 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:38.973325 (+   180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:38.973885 (+   560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:38.973908 (+    23us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:38.975353 (+  1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:38.976823 (+  1470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:38.976827 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:38.976837 (+    10us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:38.977072 (+   235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:38.977262 (+   190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:38.977264 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:38.977266 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:38.977368 (+   102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:38.977695 (+   327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:38.977701 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:38.977956 (+   255us) client_negotiation.cc:769] Sending connection context
1211 15:02:38.978136 (+   180us) client_negotiation.cc:240] Negotiation successful
1211 15:02:38.978421 (+   285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":93,"threads_started":1}
I20251211 15:02:38.980224  9872 heartbeater.cc:344] Connected to a master server at 127.5.160.190:45739
I20251211 15:02:38.980473  9872 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:38.981017  9872 heartbeater.cc:507] Master 127.5.160.190:45739 requested a full tablet report, sending...
I20251211 15:02:38.981953  9407 ts_manager.cc:194] Registered new tserver with Master: 76479cf72e784e5894bd15de2a3596cb (127.5.160.131:41269)
I20251211 15:02:38.982525  9407 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.131@KRBTEST.COM'} at 127.5.160.131:55369
I20251211 15:02:38.993265  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
Dec 11 15:02:38 dist-test-slave-4k3m krb5kdc[9359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465358, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM: 
Dec 11 15:02:39 dist-test-slave-4k3m krb5kdc[9359](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465358, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:39.015744  9446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:39.008384 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35726 (local address 127.5.160.190:45739)
1211 15:02:39.008550 (+   166us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:39.008554 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:39.008620 (+    66us) server_negotiation.cc:408] Connection header received
1211 15:02:39.008752 (+   132us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:39.008755 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:39.008804 (+    49us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:39.008865 (+    61us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:39.009667 (+   802us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:39.010164 (+   497us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:39.010810 (+   646us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:39.010981 (+   171us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:39.013041 (+  2060us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:39.013068 (+    27us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:39.013070 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:39.013097 (+    27us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:39.014490 (+  1393us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:39.014789 (+   299us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:39.014792 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:39.014793 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:39.014829 (+    36us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:39.015047 (+   218us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:39.015049 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:39.015050 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:39.015274 (+   224us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:39.015377 (+   103us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:39.015522 (+   145us) server_negotiation.cc:300] Negotiation successful
1211 15:02:39.015620 (+    98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20251211 15:02:39.016129  9407 server_base.cc:1129] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:35726
I20251211 15:02:39.017095  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 9471
I20251211 15:02:39.021903  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 9607
I20251211 15:02:39.026580  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 9743
I20251211 15:02:39.031134  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 9375
2025-12-11T15:02:39Z chronyd exiting
[       OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3006 ms)
[ RUN      ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:02:39 dist-test-slave-4k3m krb5kdc[9884](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:02:39 dist-test-slave-4k3m krb5kdc[9884](info): set up 2 sockets
Dec 11 15:02:39 dist-test-slave-4k3m krb5kdc[9884](info): commencing operation
krb5kdc: starting...
W20251211 15:02:40.871452  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.820s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:02:40 dist-test-slave-4k3m krb5kdc[9884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:02:40Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:02:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:41.002185  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:37701
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:37701
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:41.108516  9900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:41.108786  9900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:41.108862  9900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:41.112412  9900 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:02:41.112486  9900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:41.112517  9900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:41.112542  9900 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:02:41.112571  9900 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:02:41.117048  9900 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:37701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:37701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:41.118160  9900 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:41.119038  9900 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:41.124830  9908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:41.124819  9906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:41.124819  9905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:41.124902  9900 server_base.cc:1047] running on GCE node
I20251211 15:02:41.125558  9900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:41.126495  9900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:41.127638  9900 hybrid_clock.cc:648] HybridClock initialized: now 1765465361127629 us; error 26 us; skew 500 ppm
Dec 11 15:02:41 dist-test-slave-4k3m krb5kdc[9884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465361, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:41.130091  9900 init.cc:377] Logged in from keytab as kudu/127.5.160.190@KRBTEST.COM (short username kudu)
I20251211 15:02:41.131181  9900 webserver.cc:492] Webserver started at http://127.5.160.190:38291/ using document root <none> and password file <none>
I20251211 15:02:41.131729  9900 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:41.131779  9900 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:41.131959  9900 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:41.133812  9900 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "629308524be24ad380e25a70328dc550"
format_stamp: "Formatted at 2025-12-11 15:02:41 on dist-test-slave-4k3m"
server_key: "ff2261773f578024f07565fecd8b829e"
server_key_iv: "98f27f4249fc189800d10ab206994d33"
server_key_version: "encryptionkey@0"
I20251211 15:02:41.134279  9900 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "629308524be24ad380e25a70328dc550"
format_stamp: "Formatted at 2025-12-11 15:02:41 on dist-test-slave-4k3m"
server_key: "ff2261773f578024f07565fecd8b829e"
server_key_iv: "98f27f4249fc189800d10ab206994d33"
server_key_version: "encryptionkey@0"
I20251211 15:02:41.137560  9900 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20251211 15:02:41.139776  9915 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:41.140841  9900 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20251211 15:02:41.140937  9900 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "629308524be24ad380e25a70328dc550"
format_stamp: "Formatted at 2025-12-11 15:02:41 on dist-test-slave-4k3m"
server_key: "ff2261773f578024f07565fecd8b829e"
server_key_iv: "98f27f4249fc189800d10ab206994d33"
server_key_version: "encryptionkey@0"
I20251211 15:02:41.141041  9900 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:41.167578  9900 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:41.170224  9900 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:41.170419  9900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:41.177662  9900 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:37701
I20251211 15:02:41.177668  9967 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:37701 every 8 connection(s)
I20251211 15:02:41.178694  9900 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:02:41.181509  9968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:41.186972  9968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550: Bootstrap starting.
I20251211 15:02:41.187853  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 9900
I20251211 15:02:41.187968  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:02:41.188213  5762 external_mini_cluster.cc:1468] Setting key d5084b5d157daa0eda5f4fd4e7a1a8b4
I20251211 15:02:41.189654  9968 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:41.190354  9968 log.cc:826] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:41.192072  9968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550: No bootstrap required, opened a new log
I20251211 15:02:41.194630  9968 raft_consensus.cc:359] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629308524be24ad380e25a70328dc550" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37701 } }
I20251211 15:02:41.194862  9968 raft_consensus.cc:385] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:41.194954  9968 raft_consensus.cc:740] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629308524be24ad380e25a70328dc550, State: Initialized, Role: FOLLOWER
Dec 11 15:02:41 dist-test-slave-4k3m krb5kdc[9884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:41.195431  9968 consensus_queue.cc:260] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629308524be24ad380e25a70328dc550" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37701 } }
I20251211 15:02:41.195565  9968 raft_consensus.cc:399] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:02:41.195645  9968 raft_consensus.cc:493] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:02:41.195752  9968 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:41.196899  9968 raft_consensus.cc:515] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629308524be24ad380e25a70328dc550" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37701 } }
I20251211 15:02:41.197304  9968 leader_election.cc:304] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 629308524be24ad380e25a70328dc550; no voters: 
I20251211 15:02:41.197667  9968 leader_election.cc:290] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:02:41.197997  9973 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:41.198271  9973 raft_consensus.cc:697] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [term 1 LEADER]: Becoming Leader. State: Replica: 629308524be24ad380e25a70328dc550, State: Running, Role: LEADER
I20251211 15:02:41.198642  9973 consensus_queue.cc:237] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629308524be24ad380e25a70328dc550" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37701 } }
I20251211 15:02:41.198963  9968 sys_catalog.cc:565] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:02:41.201577  9971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:41.189275 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43938 (local address 127.5.160.190:37701)
1211 15:02:41.189700 (+   425us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:41.189712 (+    12us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:41.189752 (+    40us) server_negotiation.cc:408] Connection header received
1211 15:02:41.190337 (+   585us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:41.190354 (+    17us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:41.190669 (+   315us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:41.190985 (+   316us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:41.191853 (+   868us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.192609 (+   756us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:41.193242 (+   633us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.193508 (+   266us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:41.195891 (+  2383us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:41.195916 (+    25us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:41.195931 (+    15us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:41.195971 (+    40us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:41.198062 (+  2091us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:41.198566 (+   504us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:41.198572 (+     6us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:41.198579 (+     7us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:41.198688 (+   109us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:41.198994 (+   306us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:41.198997 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:41.198999 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:41.199474 (+   475us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:41.199680 (+   206us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:41.200458 (+   778us) server_negotiation.cc:300] Negotiation successful
1211 15:02:41.200748 (+   290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":143,"threads_started":1}
I20251211 15:02:41.201834  9975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 629308524be24ad380e25a70328dc550. Latest consensus state: current_term: 1 leader_uuid: "629308524be24ad380e25a70328dc550" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629308524be24ad380e25a70328dc550" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37701 } } }
I20251211 15:02:41.201905  9975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:41.201645  9974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "629308524be24ad380e25a70328dc550" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629308524be24ad380e25a70328dc550" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37701 } } }
I20251211 15:02:41.203132  9974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550 [sys.catalog]: This master's current role is: LEADER
W20251211 15:02:41.204160  9988 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251211 15:02:41.204231  9988 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251211 15:02:41.204299  9989 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:02:41.204995  9989 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:02:41.209872  9989 catalog_manager.cc:1357] Generated new cluster ID: 922f045d5ed5440f991cb68268b70e32
I20251211 15:02:41.209990  9989 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:02:41.239213  9989 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:02:41.240602  9989 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:02:41.250546  9989 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 629308524be24ad380e25a70328dc550: Generated new TSK 0
I20251211 15:02:41.251309  9989 catalog_manager.cc:1524] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:41.310173  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:37701
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:41.417776  9996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:41.418005  9996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:41.418066  9996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:41.421380  9996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:41.421460  9996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:41.421541  9996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:02:41.425972  9996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:37701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:41.427078  9996 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:41.427871  9996 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:41.434432 10001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:41.434623  9996 server_base.cc:1047] running on GCE node
W20251211 15:02:41.434430 10002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:41.434432 10004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:41.435182  9996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:41.435757  9996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:41.436921  9996 hybrid_clock.cc:648] HybridClock initialized: now 1765465361436886 us; error 45 us; skew 500 ppm
Dec 11 15:02:41 dist-test-slave-4k3m krb5kdc[9884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465361, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:41.439545  9996 init.cc:377] Logged in from keytab as kudu/127.5.160.129@KRBTEST.COM (short username kudu)
I20251211 15:02:41.440578  9996 webserver.cc:492] Webserver started at http://127.5.160.129:35771/ using document root <none> and password file <none>
I20251211 15:02:41.441098  9996 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:41.441141  9996 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:41.441303  9996 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:41.442957  9996 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "6baf22f844964193b4d7c14e7994212f"
format_stamp: "Formatted at 2025-12-11 15:02:41 on dist-test-slave-4k3m"
server_key: "3c5f8f50fed7f21c8a197925cbbccbba"
server_key_iv: "3331a5018ab477a7892644677312dfcc"
server_key_version: "encryptionkey@0"
I20251211 15:02:41.443418  9996 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "6baf22f844964193b4d7c14e7994212f"
format_stamp: "Formatted at 2025-12-11 15:02:41 on dist-test-slave-4k3m"
server_key: "3c5f8f50fed7f21c8a197925cbbccbba"
server_key_iv: "3331a5018ab477a7892644677312dfcc"
server_key_version: "encryptionkey@0"
I20251211 15:02:41.446776  9996 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20251211 15:02:41.448966 10011 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:41.449981  9996 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:02:41.450093  9996 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "6baf22f844964193b4d7c14e7994212f"
format_stamp: "Formatted at 2025-12-11 15:02:41 on dist-test-slave-4k3m"
server_key: "3c5f8f50fed7f21c8a197925cbbccbba"
server_key_iv: "3331a5018ab477a7892644677312dfcc"
server_key_version: "encryptionkey@0"
I20251211 15:02:41.450176  9996 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:41.477902  9996 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:41.480640  9996 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:41.480794  9996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:41.481302  9996 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:41.482151  9996 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:41.482197  9996 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:41.482245  9996 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:41.482266  9996 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:41.491075  9996 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:42157
I20251211 15:02:41.491093 10124 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:42157 every 8 connection(s)
I20251211 15:02:41.492041  9996 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:02:41.496042  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 9996
I20251211 15:02:41.496168  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:02:41.496434  5762 external_mini_cluster.cc:1468] Setting key 1675a57ad4fdd836a033530fe196e190
Dec 11 15:02:41 dist-test-slave-4k3m krb5kdc[9884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465361, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:41.505043  9971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:41.493723 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:59077 (local address 127.5.160.190:37701)
1211 15:02:41.493849 (+   126us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:41.493853 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:41.494520 (+   667us) server_negotiation.cc:408] Connection header received
1211 15:02:41.495428 (+   908us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:41.495431 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:41.495491 (+    60us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:41.495563 (+    72us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:41.497552 (+  1989us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.498133 (+   581us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:41.498981 (+   848us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.499119 (+   138us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:41.501615 (+  2496us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:41.501636 (+    21us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:41.501639 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:41.501666 (+    27us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:41.503040 (+  1374us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:41.503623 (+   583us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:41.503626 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:41.503627 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:41.503670 (+    43us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:41.503954 (+   284us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:41.503956 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:41.503957 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:41.504106 (+   149us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:41.504172 (+    66us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:41.504807 (+   635us) server_negotiation.cc:300] Negotiation successful
1211 15:02:41.504917 (+   110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
WARNING: no policy specified for kudu/127.5.160.130@KRBTEST.COM; defaulting to no policy
I20251211 15:02:41.506042 10127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:41.493951 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:37701 (local address 127.5.160.129:59077)
1211 15:02:41.494365 (+   414us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:41.494402 (+    37us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:41.495239 (+   837us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:41.495711 (+   472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:41.495719 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:41.496265 (+   546us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:41.497407 (+  1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:41.497422 (+    15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.498265 (+   843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:41.498269 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:41.498829 (+   560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:41.498839 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.499085 (+   246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:41.499772 (+   687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:41.499796 (+    24us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:41.501448 (+  1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:41.503160 (+  1712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:41.503166 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:41.503180 (+    14us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:41.503528 (+   348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:41.503741 (+   213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:41.503745 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:41.503747 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:41.503875 (+   128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:41.504196 (+   321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:41.504204 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:41.504541 (+   337us) client_negotiation.cc:769] Sending connection context
1211 15:02:41.504801 (+   260us) client_negotiation.cc:240] Negotiation successful
1211 15:02:41.505212 (+   411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":107,"threads_started":1}
I20251211 15:02:41.507270 10125 heartbeater.cc:344] Connected to a master server at 127.5.160.190:37701
I20251211 15:02:41.507541 10125 heartbeater.cc:461] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.130@KRBTEST.COM" created.
I20251211 15:02:41.508095 10125 heartbeater.cc:507] Master 127.5.160.190:37701 requested a full tablet report, sending...
I20251211 15:02:41.509671  9932 ts_manager.cc:194] Registered new tserver with Master: 6baf22f844964193b4d7c14e7994212f (127.5.160.129:42157)
I20251211 15:02:41.510977  9932 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:59077
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:41.543342  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:37701
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:41.649027 10132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:41.649273 10132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:41.649333 10132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:41.652675 10132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:41.652747 10132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:41.652827 10132 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:02:41.657177 10132 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:37701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:41.658279 10132 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:41.659107 10132 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:41.665882 10137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:41.665947 10138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:41.665880 10140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:41.666101 10132 server_base.cc:1047] running on GCE node
I20251211 15:02:41.666498 10132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:41.667093 10132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:41.668244 10132 hybrid_clock.cc:648] HybridClock initialized: now 1765465361668240 us; error 45 us; skew 500 ppm
Dec 11 15:02:41 dist-test-slave-4k3m krb5kdc[9884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465361, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:41.670806 10132 init.cc:377] Logged in from keytab as kudu/127.5.160.130@KRBTEST.COM (short username kudu)
I20251211 15:02:41.672019 10132 webserver.cc:492] Webserver started at http://127.5.160.130:34157/ using document root <none> and password file <none>
I20251211 15:02:41.672576 10132 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:41.672627 10132 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:41.672808 10132 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:41.674504 10132 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "618542fae14d44c4a029f3c71d9ca096"
format_stamp: "Formatted at 2025-12-11 15:02:41 on dist-test-slave-4k3m"
server_key: "dd803652bef950a7d308b937afeaa350"
server_key_iv: "1480aff28ae5f082a133a09a9e98f6ea"
server_key_version: "encryptionkey@0"
I20251211 15:02:41.674993 10132 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "618542fae14d44c4a029f3c71d9ca096"
format_stamp: "Formatted at 2025-12-11 15:02:41 on dist-test-slave-4k3m"
server_key: "dd803652bef950a7d308b937afeaa350"
server_key_iv: "1480aff28ae5f082a133a09a9e98f6ea"
server_key_version: "encryptionkey@0"
I20251211 15:02:41.678460 10132 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.003s
I20251211 15:02:41.680805 10147 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:41.681893 10132 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:02:41.682018 10132 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "618542fae14d44c4a029f3c71d9ca096"
format_stamp: "Formatted at 2025-12-11 15:02:41 on dist-test-slave-4k3m"
server_key: "dd803652bef950a7d308b937afeaa350"
server_key_iv: "1480aff28ae5f082a133a09a9e98f6ea"
server_key_version: "encryptionkey@0"
I20251211 15:02:41.682116 10132 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:41.698559 10132 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:41.701671 10132 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:41.701858 10132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:41.702416 10132 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:41.703320 10132 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:41.703369 10132 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:41.703421 10132 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:41.703449 10132 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:41.711691 10132 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:43037
I20251211 15:02:41.711725 10260 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:43037 every 8 connection(s)
I20251211 15:02:41.712613 10132 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:02:41.719166  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 10132
I20251211 15:02:41.719273  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:02:41.719484  5762 external_mini_cluster.cc:1468] Setting key f7aa1c7894d37a8df922931d85c0897a
Dec 11 15:02:41 dist-test-slave-4k3m krb5kdc[9884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465361, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:41.724593  9971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:41.714282 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:37639 (local address 127.5.160.190:37701)
1211 15:02:41.714450 (+   168us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:41.714455 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:41.715113 (+   658us) server_negotiation.cc:408] Connection header received
1211 15:02:41.715932 (+   819us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:41.715935 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:41.715982 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:41.716051 (+    69us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:41.717618 (+  1567us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.718105 (+   487us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:41.718750 (+   645us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.718870 (+   120us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:41.721244 (+  2374us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:41.721259 (+    15us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:41.721261 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:41.721285 (+    24us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:41.722728 (+  1443us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:41.723219 (+   491us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:41.723222 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:41.723224 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:41.723274 (+    50us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:41.723514 (+   240us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:41.723517 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:41.723518 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:41.723684 (+   166us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:41.723771 (+    87us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:41.724294 (+   523us) server_negotiation.cc:300] Negotiation successful
1211 15:02:41.724434 (+   140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20251211 15:02:41.725174 10263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:41.714544 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:37701 (local address 127.5.160.130:37639)
1211 15:02:41.714988 (+   444us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:41.715023 (+    35us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:41.715764 (+   741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:41.716225 (+   461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:41.716232 (+     7us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:41.716609 (+   377us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:41.717498 (+   889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:41.717512 (+    14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.718250 (+   738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:41.718254 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:41.718665 (+   411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:41.718672 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.718841 (+   169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:41.719502 (+   661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:41.719528 (+    26us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:41.721074 (+  1546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:41.722842 (+  1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:41.722846 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:41.722855 (+     9us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:41.723126 (+   271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:41.723354 (+   228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:41.723356 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:41.723358 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:41.723439 (+    81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:41.723763 (+   324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:41.723768 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:41.724006 (+   238us) client_negotiation.cc:769] Sending connection context
1211 15:02:41.724215 (+   209us) client_negotiation.cc:240] Negotiation successful
1211 15:02:41.724448 (+   233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":111,"threads_started":1}
I20251211 15:02:41.726343 10261 heartbeater.cc:344] Connected to a master server at 127.5.160.190:37701
I20251211 15:02:41.726578 10261 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:41.727110 10261 heartbeater.cc:507] Master 127.5.160.190:37701 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.5.160.131@KRBTEST.COM; defaulting to no policy
I20251211 15:02:41.728149  9932 ts_manager.cc:194] Registered new tserver with Master: 618542fae14d44c4a029f3c71d9ca096 (127.5.160.130:43037)
I20251211 15:02:41.728720  9932 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.130@KRBTEST.COM'} at 127.5.160.130:37639
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:41.765672  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:37701
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:41.870877 10268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:41.871158 10268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:41.871244 10268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:41.874562 10268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:41.874635 10268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:41.874737 10268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:02:41.879182 10268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:37701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:41.880303 10268 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:41.881139 10268 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:41.888142 10276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:41.888159 10274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:41.888142 10273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:41.888362 10268 server_base.cc:1047] running on GCE node
I20251211 15:02:41.888813 10268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:41.889367 10268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:41.890539 10268 hybrid_clock.cc:648] HybridClock initialized: now 1765465361890522 us; error 32 us; skew 500 ppm
Dec 11 15:02:41 dist-test-slave-4k3m krb5kdc[9884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465361, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:41.893118 10268 init.cc:377] Logged in from keytab as kudu/127.5.160.131@KRBTEST.COM (short username kudu)
I20251211 15:02:41.894131 10268 webserver.cc:492] Webserver started at http://127.5.160.131:42459/ using document root <none> and password file <none>
I20251211 15:02:41.894645 10268 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:41.894688 10268 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:41.894840 10268 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:41.896571 10268 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "e4313ad88c7e4c8d8d3e50ad0ac2e79e"
format_stamp: "Formatted at 2025-12-11 15:02:41 on dist-test-slave-4k3m"
server_key: "cb16a9a36ea3c78b694042e7919f47f3"
server_key_iv: "482df9f89b192d2b2f6d57ea1db5bd3b"
server_key_version: "encryptionkey@0"
I20251211 15:02:41.896991 10268 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "e4313ad88c7e4c8d8d3e50ad0ac2e79e"
format_stamp: "Formatted at 2025-12-11 15:02:41 on dist-test-slave-4k3m"
server_key: "cb16a9a36ea3c78b694042e7919f47f3"
server_key_iv: "482df9f89b192d2b2f6d57ea1db5bd3b"
server_key_version: "encryptionkey@0"
I20251211 15:02:41.900290 10268 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20251211 15:02:41.902649 10283 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:41.903733 10268 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:02:41.903831 10268 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "e4313ad88c7e4c8d8d3e50ad0ac2e79e"
format_stamp: "Formatted at 2025-12-11 15:02:41 on dist-test-slave-4k3m"
server_key: "cb16a9a36ea3c78b694042e7919f47f3"
server_key_iv: "482df9f89b192d2b2f6d57ea1db5bd3b"
server_key_version: "encryptionkey@0"
I20251211 15:02:41.903910 10268 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:41.924585 10268 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:41.927575 10268 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:41.927739 10268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:41.928259 10268 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:41.929107 10268 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:41.929155 10268 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:41.929203 10268 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:41.929229 10268 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:41.938012 10268 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:40401
I20251211 15:02:41.938026 10396 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:40401 every 8 connection(s)
I20251211 15:02:41.939047 10268 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
I20251211 15:02:41.941346  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 10268
I20251211 15:02:41.941476  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:02:41.941717  5762 external_mini_cluster.cc:1468] Setting key e13c83894489eda1436a68cdbbb56dd9
Dec 11 15:02:41 dist-test-slave-4k3m krb5kdc[9884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465361, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:41.950999  9971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:41.940774 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:48621 (local address 127.5.160.190:37701)
1211 15:02:41.940934 (+   160us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:41.940938 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:41.941667 (+   729us) server_negotiation.cc:408] Connection header received
1211 15:02:41.942606 (+   939us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:41.942610 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:41.942668 (+    58us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:41.942741 (+    73us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:41.944568 (+  1827us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.945089 (+   521us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:41.945775 (+   686us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.945911 (+   136us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:41.948017 (+  2106us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:41.948035 (+    18us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:41.948037 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:41.948063 (+    26us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:41.949253 (+  1190us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:41.949697 (+   444us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:41.949700 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:41.949701 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:41.949741 (+    40us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:41.949952 (+   211us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:41.949954 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:41.949955 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:41.950114 (+   159us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:41.950186 (+    72us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:41.950730 (+   544us) server_negotiation.cc:300] Negotiation successful
1211 15:02:41.950837 (+   107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20251211 15:02:41.951651 10399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:41.941032 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:37701 (local address 127.5.160.131:48621)
1211 15:02:41.941516 (+   484us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:41.941559 (+    43us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:41.942384 (+   825us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:41.942952 (+   568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:41.942965 (+    13us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:41.943396 (+   431us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:41.944407 (+  1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:41.944423 (+    16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.945230 (+   807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:41.945234 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:41.945665 (+   431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:41.945674 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.945848 (+   174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:41.946411 (+   563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:41.946437 (+    26us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:41.947880 (+  1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:41.949362 (+  1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:41.949367 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:41.949377 (+    10us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:41.949619 (+   242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:41.949804 (+   185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:41.949807 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:41.949808 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:41.949891 (+    83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:41.950228 (+   337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:41.950234 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:41.950492 (+   258us) client_negotiation.cc:769] Sending connection context
1211 15:02:41.950673 (+   181us) client_negotiation.cc:240] Negotiation successful
1211 15:02:41.950895 (+   222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":134,"threads_started":1}
I20251211 15:02:41.952749 10397 heartbeater.cc:344] Connected to a master server at 127.5.160.190:37701
I20251211 15:02:41.952999 10397 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:41.953545 10397 heartbeater.cc:507] Master 127.5.160.190:37701 requested a full tablet report, sending...
I20251211 15:02:41.954628  9932 ts_manager.cc:194] Registered new tserver with Master: e4313ad88c7e4c8d8d3e50ad0ac2e79e (127.5.160.131:40401)
I20251211 15:02:41.955361  9932 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.131@KRBTEST.COM'} at 127.5.160.131:48621
I20251211 15:02:41.955646  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
Dec 11 15:02:41 dist-test-slave-4k3m krb5kdc[9884](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
Dec 11 15:02:41 dist-test-slave-4k3m krb5kdc[9884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.129@KRBTEST.COM
I20251211 15:02:41.978910 10404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:41.970631 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57436 (local address 127.5.160.129:42157)
1211 15:02:41.970965 (+   334us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:41.970972 (+     7us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:41.970999 (+    27us) server_negotiation.cc:408] Connection header received
1211 15:02:41.971053 (+    54us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:41.971057 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:41.971222 (+   165us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:41.971342 (+   120us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:41.972133 (+   791us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.972824 (+   691us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:41.973461 (+   637us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.973651 (+   190us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:41.975663 (+  2012us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:41.975689 (+    26us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:41.975707 (+    18us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:41.975735 (+    28us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:41.977417 (+  1682us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:41.977809 (+   392us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:41.977814 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:41.977816 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:41.977878 (+    62us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:41.978046 (+   168us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:41.978049 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:41.978050 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:41.978313 (+   263us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:41.978489 (+   176us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:41.978629 (+   140us) server_negotiation.cc:300] Negotiation successful
1211 15:02:41.978760 (+   131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":121,"threads_started":1}
Dec 11 15:02:41 dist-test-slave-4k3m krb5kdc[9884](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:41.989073  9971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:41.981618 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43942 (local address 127.5.160.190:37701)
1211 15:02:41.981735 (+   117us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:41.981738 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:41.981752 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:02:41.981787 (+    35us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:41.981790 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:41.981830 (+    40us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:41.981893 (+    63us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:41.982492 (+   599us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.983020 (+   528us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:41.983766 (+   746us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:41.983909 (+   143us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:41.985984 (+  2075us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:41.986004 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:41.986006 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:41.986043 (+    37us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:41.987445 (+  1402us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:41.987952 (+   507us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:41.987955 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:41.987957 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:41.988006 (+    49us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:41.988268 (+   262us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:41.988271 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:41.988273 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:41.988478 (+   205us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:41.988600 (+   122us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:41.988805 (+   205us) server_negotiation.cc:300] Negotiation successful
1211 15:02:41.988918 (+   113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20251211 15:02:41.989462  9932 server_base.cc:1129] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43942
I20251211 15:02:41.990103  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 9996
I20251211 15:02:41.995157  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 10132
I20251211 15:02:41.999982  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 10268
I20251211 15:02:42.004643  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 9900
2025-12-11T15:02:42Z chronyd exiting
[       OK ] SecurityITest.TestAuthorizedSuperuser (2973 ms)
[ RUN      ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:02:42 dist-test-slave-4k3m krb5kdc[10409](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:02:42 dist-test-slave-4k3m krb5kdc[10409](info): set up 2 sockets
Dec 11 15:02:42 dist-test-slave-4k3m krb5kdc[10409](info): commencing operation
krb5kdc: starting...
W20251211 15:02:43.855341  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.830s	user 0.003s	sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:02:43 dist-test-slave-4k3m krb5kdc[10409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:02:43Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:02:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:43.995218  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40651
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:36759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:40651
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:44.103406 10425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:44.103670 10425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:44.103750 10425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:44.107203 10425 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:02:44.107282 10425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:44.107314 10425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:44.107340 10425 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:02:44.107373 10425 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:02:44.111941 10425 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:36759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:40651
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:44.113121 10425 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:44.113976 10425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:44.119731 10430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:44.119741 10433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:44.119722 10431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:44.119930 10425 server_base.cc:1047] running on GCE node
I20251211 15:02:44.120561 10425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:44.121572 10425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:44.122718 10425 hybrid_clock.cc:648] HybridClock initialized: now 1765465364122698 us; error 35 us; skew 500 ppm
Dec 11 15:02:44 dist-test-slave-4k3m krb5kdc[10409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465364, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:44.125331 10425 init.cc:377] Logged in from keytab as kudu/127.5.160.190@KRBTEST.COM (short username kudu)
I20251211 15:02:44.126057 10425 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:44.126113 10425 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:44.126300 10425 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:44.127991 10425 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "10e4914db0474beb9b5f59ee66d88d62"
format_stamp: "Formatted at 2025-12-11 15:02:44 on dist-test-slave-4k3m"
server_key: "5b77b9c00eaa77b6f3682ad22d57dff0"
server_key_iv: "e48a7a3ecc41da387cc4ec7b651db9df"
server_key_version: "encryptionkey@0"
I20251211 15:02:44.128512 10425 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "10e4914db0474beb9b5f59ee66d88d62"
format_stamp: "Formatted at 2025-12-11 15:02:44 on dist-test-slave-4k3m"
server_key: "5b77b9c00eaa77b6f3682ad22d57dff0"
server_key_iv: "e48a7a3ecc41da387cc4ec7b651db9df"
server_key_version: "encryptionkey@0"
I20251211 15:02:44.131913 10425 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20251211 15:02:44.134217 10439 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:44.135334 10425 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:02:44.135452 10425 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "10e4914db0474beb9b5f59ee66d88d62"
format_stamp: "Formatted at 2025-12-11 15:02:44 on dist-test-slave-4k3m"
server_key: "5b77b9c00eaa77b6f3682ad22d57dff0"
server_key_iv: "e48a7a3ecc41da387cc4ec7b651db9df"
server_key_version: "encryptionkey@0"
I20251211 15:02:44.135551 10425 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:44.148715 10425 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:44.154886 10425 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:44.155114 10425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:44.163038 10491 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:40651 every 8 connection(s)
I20251211 15:02:44.163061 10425 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:40651
I20251211 15:02:44.163774 10425 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:02:44.166913 10492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:44.171022  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 10425
I20251211 15:02:44.171145  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:02:44.171378  5762 external_mini_cluster.cc:1468] Setting key 715d93ea24805d9cd94200f8077df5da
I20251211 15:02:44.172850 10492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62: Bootstrap starting.
I20251211 15:02:44.175220 10492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:44.175905 10492 log.cc:826] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:44.177943 10492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62: No bootstrap required, opened a new log
Dec 11 15:02:44 dist-test-slave-4k3m krb5kdc[10409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:44.180510 10492 raft_consensus.cc:359] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e4914db0474beb9b5f59ee66d88d62" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40651 } }
I20251211 15:02:44.180699 10492 raft_consensus.cc:385] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:44.180738 10492 raft_consensus.cc:740] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10e4914db0474beb9b5f59ee66d88d62, State: Initialized, Role: FOLLOWER
I20251211 15:02:44.181165 10492 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e4914db0474beb9b5f59ee66d88d62" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40651 } }
I20251211 15:02:44.181294 10492 raft_consensus.cc:399] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:02:44.181353 10492 raft_consensus.cc:493] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:02:44.181442 10492 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:44.182231 10492 raft_consensus.cc:515] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e4914db0474beb9b5f59ee66d88d62" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40651 } }
I20251211 15:02:44.182567 10492 leader_election.cc:304] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10e4914db0474beb9b5f59ee66d88d62; no voters: 
I20251211 15:02:44.182854 10492 leader_election.cc:290] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:02:44.183329 10497 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:44.183530 10497 raft_consensus.cc:697] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [term 1 LEADER]: Becoming Leader. State: Replica: 10e4914db0474beb9b5f59ee66d88d62, State: Running, Role: LEADER
I20251211 15:02:44.183743 10495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:44.172631 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36898 (local address 127.5.160.190:40651)
1211 15:02:44.173011 (+   380us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:44.173022 (+    11us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:44.173054 (+    32us) server_negotiation.cc:408] Connection header received
1211 15:02:44.173593 (+   539us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:44.173609 (+    16us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:44.173884 (+   275us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:44.174144 (+   260us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:44.175166 (+  1022us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.175956 (+   790us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:44.176696 (+   740us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.176912 (+   216us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:44.179321 (+  2409us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:44.179340 (+    19us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:44.179351 (+    11us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:44.179385 (+    34us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:44.181162 (+  1777us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:44.181609 (+   447us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:44.181614 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:44.181619 (+     5us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:44.181696 (+    77us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:44.181913 (+   217us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:44.181917 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:44.181919 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:44.182258 (+   339us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:44.182439 (+   181us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:44.182711 (+   272us) server_negotiation.cc:300] Negotiation successful
1211 15:02:44.183013 (+   302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":111,"threads_started":1}
I20251211 15:02:44.183815 10497 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e4914db0474beb9b5f59ee66d88d62" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40651 } }
I20251211 15:02:44.184084 10492 sys_catalog.cc:565] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:02:44.186003 10498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10e4914db0474beb9b5f59ee66d88d62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e4914db0474beb9b5f59ee66d88d62" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40651 } } }
I20251211 15:02:44.186128 10498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:44.186509 10499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10e4914db0474beb9b5f59ee66d88d62. Latest consensus state: current_term: 1 leader_uuid: "10e4914db0474beb9b5f59ee66d88d62" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10e4914db0474beb9b5f59ee66d88d62" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40651 } } }
I20251211 15:02:44.186654 10499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62 [sys.catalog]: This master's current role is: LEADER
W20251211 15:02:44.188673 10511 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251211 15:02:44.188752 10511 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251211 15:02:44.188854 10512 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:02:44.189675 10512 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:02:44.194741 10512 catalog_manager.cc:1357] Generated new cluster ID: 2cb02ca8f8624c8cb4e2a80cec919b43
I20251211 15:02:44.194815 10512 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:02:44.206863 10512 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:02:44.208107 10512 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:02:44.216178 10512 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62: Generated new TSK 0
I20251211 15:02:44.216910 10512 catalog_manager.cc:1524] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:44.274639  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40651
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:36759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:44.381034 10520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:44.381271 10520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:44.381353 10520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:44.384706 10520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:44.384784 10520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:44.384891 10520 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:02:44.389693 10520 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:36759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:40651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:44.390830 10520 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:44.391708 10520 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:44.398313 10525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:44.398313 10528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:44.398388 10526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:44.398625 10520 server_base.cc:1047] running on GCE node
I20251211 15:02:44.399022 10520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:44.399600 10520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:44.400750 10520 hybrid_clock.cc:648] HybridClock initialized: now 1765465364400736 us; error 29 us; skew 500 ppm
Dec 11 15:02:44 dist-test-slave-4k3m krb5kdc[10409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465364, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:44.403309 10520 init.cc:377] Logged in from keytab as kudu/127.5.160.129@KRBTEST.COM (short username kudu)
I20251211 15:02:44.403998 10520 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:44.404052 10520 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:44.404208 10520 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:44.405925 10520 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "9ba64233904941768f895a52afa8e986"
format_stamp: "Formatted at 2025-12-11 15:02:44 on dist-test-slave-4k3m"
server_key: "730af561025c4acb15e520e647f6188d"
server_key_iv: "48f318ef32408c43f304b0b5757928d2"
server_key_version: "encryptionkey@0"
I20251211 15:02:44.406401 10520 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "9ba64233904941768f895a52afa8e986"
format_stamp: "Formatted at 2025-12-11 15:02:44 on dist-test-slave-4k3m"
server_key: "730af561025c4acb15e520e647f6188d"
server_key_iv: "48f318ef32408c43f304b0b5757928d2"
server_key_version: "encryptionkey@0"
I20251211 15:02:44.409937 10520 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20251211 15:02:44.412375 10534 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:44.413493 10520 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:02:44.413599 10520 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "9ba64233904941768f895a52afa8e986"
format_stamp: "Formatted at 2025-12-11 15:02:44 on dist-test-slave-4k3m"
server_key: "730af561025c4acb15e520e647f6188d"
server_key_iv: "48f318ef32408c43f304b0b5757928d2"
server_key_version: "encryptionkey@0"
I20251211 15:02:44.413703 10520 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:44.424674 10520 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:44.427826 10520 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:44.428011 10520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:44.428740 10520 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:44.429641 10520 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:44.429689 10520 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:44.429730 10520 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:44.429760 10520 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:44.438853 10520 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:41351
I20251211 15:02:44.438951 10647 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:41351 every 8 connection(s)
I20251211 15:02:44.439455 10520 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:02:44.440725  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 10520
I20251211 15:02:44.440826  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:02:44.441053  5762 external_mini_cluster.cc:1468] Setting key 5920df4b287660e13fcf0acc6ddc32a7
Dec 11 15:02:44 dist-test-slave-4k3m krb5kdc[10409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465364, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.130@KRBTEST.COM" created.
I20251211 15:02:44.452804 10495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:44.441209 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:41559 (local address 127.5.160.190:40651)
1211 15:02:44.441381 (+   172us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:44.441386 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:44.442119 (+   733us) server_negotiation.cc:408] Connection header received
1211 15:02:44.443075 (+   956us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:44.443079 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:44.443131 (+    52us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:44.443224 (+    93us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:44.444807 (+  1583us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.445325 (+   518us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:44.446220 (+   895us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.446400 (+   180us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:44.448964 (+  2564us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:44.448985 (+    21us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:44.448987 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:44.449015 (+    28us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:44.450676 (+  1661us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:44.451291 (+   615us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:44.451295 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:44.451296 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:44.451350 (+    54us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:44.451668 (+   318us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:44.451672 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:44.451673 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:44.451848 (+   175us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:44.451949 (+   101us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:44.452527 (+   578us) server_negotiation.cc:300] Negotiation successful
1211 15:02:44.452663 (+   136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20251211 15:02:44.453519 10650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:44.441503 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40651 (local address 127.5.160.129:41559)
1211 15:02:44.441982 (+   479us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:44.442026 (+    44us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:44.442837 (+   811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:44.443345 (+   508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:44.443352 (+     7us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:44.443730 (+   378us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:44.444648 (+   918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:44.444662 (+    14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.445490 (+   828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:44.445494 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:44.446102 (+   608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:44.446112 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.446332 (+   220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:44.446972 (+   640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:44.447012 (+    40us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:44.448778 (+  1766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:44.450820 (+  2042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:44.450827 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:44.450841 (+    14us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:44.451168 (+   327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:44.451457 (+   289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:44.451459 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:44.451461 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:44.451551 (+    90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:44.451958 (+   407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:44.451964 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:44.452246 (+   282us) client_negotiation.cc:769] Sending connection context
1211 15:02:44.452499 (+   253us) client_negotiation.cc:240] Negotiation successful
1211 15:02:44.452808 (+   309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":127,"threads_started":1}
I20251211 15:02:44.454766 10648 heartbeater.cc:344] Connected to a master server at 127.5.160.190:40651
I20251211 15:02:44.455034 10648 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:44.455534 10648 heartbeater.cc:507] Master 127.5.160.190:40651 requested a full tablet report, sending...
I20251211 15:02:44.456951 10456 ts_manager.cc:194] Registered new tserver with Master: 9ba64233904941768f895a52afa8e986 (127.5.160.129:41351)
I20251211 15:02:44.458123 10456 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:41559
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:44.489856  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40651
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:36759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:44.598354 10655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:44.598614 10655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:44.598701 10655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:44.601981 10655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:44.602052 10655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:44.602167 10655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:02:44.606390 10655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:36759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:40651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:44.607533 10655 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:44.608355 10655 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:44.614744 10663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:44.614748 10661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:44.614861 10660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:44.614984 10655 server_base.cc:1047] running on GCE node
I20251211 15:02:44.615487 10655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:44.616056 10655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:44.617233 10655 hybrid_clock.cc:648] HybridClock initialized: now 1765465364617216 us; error 33 us; skew 500 ppm
Dec 11 15:02:44 dist-test-slave-4k3m krb5kdc[10409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465364, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:44.620095 10655 init.cc:377] Logged in from keytab as kudu/127.5.160.130@KRBTEST.COM (short username kudu)
I20251211 15:02:44.620880 10655 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:44.620944 10655 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:44.621124 10655 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:44.622848 10655 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "4650732fefac4c4ab33cc62988ba78a2"
format_stamp: "Formatted at 2025-12-11 15:02:44 on dist-test-slave-4k3m"
server_key: "d8ea8703e335c0188bd3ca321810e64c"
server_key_iv: "56fccdc67daedf03cdd217f764a8502c"
server_key_version: "encryptionkey@0"
I20251211 15:02:44.623395 10655 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "4650732fefac4c4ab33cc62988ba78a2"
format_stamp: "Formatted at 2025-12-11 15:02:44 on dist-test-slave-4k3m"
server_key: "d8ea8703e335c0188bd3ca321810e64c"
server_key_iv: "56fccdc67daedf03cdd217f764a8502c"
server_key_version: "encryptionkey@0"
I20251211 15:02:44.627024 10655 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20251211 15:02:44.629456 10669 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:44.630654 10655 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:02:44.630776 10655 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "4650732fefac4c4ab33cc62988ba78a2"
format_stamp: "Formatted at 2025-12-11 15:02:44 on dist-test-slave-4k3m"
server_key: "d8ea8703e335c0188bd3ca321810e64c"
server_key_iv: "56fccdc67daedf03cdd217f764a8502c"
server_key_version: "encryptionkey@0"
I20251211 15:02:44.630879 10655 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:44.644708 10655 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:44.647758 10655 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:44.647940 10655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:44.648490 10655 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:44.649385 10655 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:44.649443 10655 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:44.649497 10655 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:44.649524 10655 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:44.658639 10655 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:45737
I20251211 15:02:44.658674 10782 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:45737 every 8 connection(s)
I20251211 15:02:44.659246 10655 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:02:44.659621  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 10655
I20251211 15:02:44.659752  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:02:44.660023  5762 external_mini_cluster.cc:1468] Setting key f2c0ad29c91fea32a1f9e018323acc66
Dec 11 15:02:44 dist-test-slave-4k3m krb5kdc[10409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465364, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.131@KRBTEST.COM" created.
I20251211 15:02:44.671892 10495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:44.661095 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:44827 (local address 127.5.160.190:40651)
1211 15:02:44.661266 (+   171us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:44.661271 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:44.662022 (+   751us) server_negotiation.cc:408] Connection header received
1211 15:02:44.662875 (+   853us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:44.662880 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:44.662960 (+    80us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:44.663040 (+    80us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:44.664684 (+  1644us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.665180 (+   496us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:44.665814 (+   634us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.665981 (+   167us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:44.668338 (+  2357us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:44.668364 (+    26us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:44.668367 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:44.668399 (+    32us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:44.669863 (+  1464us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:44.670411 (+   548us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:44.670415 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:44.670417 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:44.670466 (+    49us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:44.670746 (+   280us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:44.670750 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:44.670752 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:44.670918 (+   166us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:44.671034 (+   116us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:44.671596 (+   562us) server_negotiation.cc:300] Negotiation successful
1211 15:02:44.671728 (+   132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20251211 15:02:44.672475 10785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:44.661395 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40651 (local address 127.5.160.130:44827)
1211 15:02:44.661894 (+   499us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:44.661931 (+    37us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:44.662687 (+   756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:44.663202 (+   515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:44.663211 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:44.663620 (+   409us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:44.664538 (+   918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:44.664551 (+    13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.665297 (+   746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:44.665300 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:44.665707 (+   407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:44.665713 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.665909 (+   196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:44.666584 (+   675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:44.666610 (+    26us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:44.668163 (+  1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:44.670014 (+  1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:44.670020 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:44.670035 (+    15us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:44.670308 (+   273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:44.670547 (+   239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:44.670550 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:44.670553 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:44.670654 (+   101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:44.671083 (+   429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:44.671089 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:44.671332 (+   243us) client_negotiation.cc:769] Sending connection context
1211 15:02:44.671513 (+   181us) client_negotiation.cc:240] Negotiation successful
1211 15:02:44.671741 (+   228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":132,"threads_started":1}
I20251211 15:02:44.673610 10783 heartbeater.cc:344] Connected to a master server at 127.5.160.190:40651
I20251211 15:02:44.673882 10783 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:44.674492 10783 heartbeater.cc:507] Master 127.5.160.190:40651 requested a full tablet report, sending...
I20251211 15:02:44.675740 10456 ts_manager.cc:194] Registered new tserver with Master: 4650732fefac4c4ab33cc62988ba78a2 (127.5.160.130:45737)
I20251211 15:02:44.676353 10456 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.130@KRBTEST.COM'} at 127.5.160.130:44827
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:02:44.710728  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40651
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:36759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:02:44.818807 10790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:44.819072 10790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:44.819149 10790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:44.822525 10790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:44.822605 10790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:44.822697 10790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:02:44.827260 10790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:36759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:40651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:44.828367 10790 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:44.829197 10790 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:44.835767 10798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:44.835767 10796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:44.835852 10790 server_base.cc:1047] running on GCE node
W20251211 15:02:44.835790 10795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:44.836402 10790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:44.836969 10790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:44.838129 10790 hybrid_clock.cc:648] HybridClock initialized: now 1765465364838105 us; error 37 us; skew 500 ppm
Dec 11 15:02:44 dist-test-slave-4k3m krb5kdc[10409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465364, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:02:44.840883 10790 init.cc:377] Logged in from keytab as kudu/127.5.160.131@KRBTEST.COM (short username kudu)
I20251211 15:02:44.841586 10790 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:44.841640 10790 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:44.841809 10790 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:44.843519 10790 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "eb1246d2b8ef4068866326a321350f80"
format_stamp: "Formatted at 2025-12-11 15:02:44 on dist-test-slave-4k3m"
server_key: "7cb91d93c7261b6d97713248327979be"
server_key_iv: "5a2f7d2b89147575cbdf946582fd06b2"
server_key_version: "encryptionkey@0"
I20251211 15:02:44.843971 10790 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "eb1246d2b8ef4068866326a321350f80"
format_stamp: "Formatted at 2025-12-11 15:02:44 on dist-test-slave-4k3m"
server_key: "7cb91d93c7261b6d97713248327979be"
server_key_iv: "5a2f7d2b89147575cbdf946582fd06b2"
server_key_version: "encryptionkey@0"
I20251211 15:02:44.847543 10790 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20251211 15:02:44.849836 10804 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:44.850993 10790 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:02:44.851086 10790 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "eb1246d2b8ef4068866326a321350f80"
format_stamp: "Formatted at 2025-12-11 15:02:44 on dist-test-slave-4k3m"
server_key: "7cb91d93c7261b6d97713248327979be"
server_key_iv: "5a2f7d2b89147575cbdf946582fd06b2"
server_key_version: "encryptionkey@0"
I20251211 15:02:44.851166 10790 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:44.872507 10790 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:44.875463 10790 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:44.875628 10790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:44.876135 10790 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:44.876981 10790 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:44.877027 10790 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:44.877065 10790 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:44.877082 10790 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:44.885952 10790 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:38757
I20251211 15:02:44.885998 10917 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:38757 every 8 connection(s)
I20251211 15:02:44.886528 10790 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
Dec 11 15:02:44 dist-test-slave-4k3m krb5kdc[10409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465364, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:02:44.896795  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 10790
I20251211 15:02:44.896931  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:02:44.897212  5762 external_mini_cluster.cc:1468] Setting key 569337b9ed0c3147bd5b186218535394
I20251211 15:02:44.898370 10495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:44.888184 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:52355 (local address 127.5.160.190:40651)
1211 15:02:44.888348 (+   164us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:44.888353 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:44.889010 (+   657us) server_negotiation.cc:408] Connection header received
1211 15:02:44.889801 (+   791us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:44.889804 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:44.889852 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:44.889924 (+    72us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:44.891605 (+  1681us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.892109 (+   504us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:44.892769 (+   660us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.892892 (+   123us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:44.894910 (+  2018us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:44.894952 (+    42us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:44.894956 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:44.894987 (+    31us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:44.896325 (+  1338us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:44.896906 (+   581us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:44.896909 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:44.896911 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:44.896960 (+    49us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:44.897244 (+   284us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:44.897247 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:44.897248 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:44.897416 (+   168us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:44.897512 (+    96us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:44.898082 (+   570us) server_negotiation.cc:300] Negotiation successful
1211 15:02:44.898222 (+   140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20251211 15:02:44.899052 10920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:44.888456 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40651 (local address 127.5.160.131:52355)
1211 15:02:44.888877 (+   421us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:44.888912 (+    35us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:44.889631 (+   719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:44.890087 (+   456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:44.890094 (+     7us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:44.890478 (+   384us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:44.891469 (+   991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:44.891483 (+    14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.892241 (+   758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:44.892244 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:44.892680 (+   436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:44.892687 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.892859 (+   172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:44.893368 (+   509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:02:44.893390 (+    22us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:44.894768 (+  1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:44.896449 (+  1681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:44.896454 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:44.896465 (+    11us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:44.896798 (+   333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:44.897056 (+   258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:02:44.897058 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:02:44.897060 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:02:44.897152 (+    92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:02:44.897520 (+   368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:44.897527 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:44.897802 (+   275us) client_negotiation.cc:769] Sending connection context
1211 15:02:44.898015 (+   213us) client_negotiation.cc:240] Negotiation successful
1211 15:02:44.898308 (+   293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":102,"threads_started":1}
I20251211 15:02:44.899962 10918 heartbeater.cc:344] Connected to a master server at 127.5.160.190:40651
I20251211 15:02:44.900187 10918 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:44.900665 10918 heartbeater.cc:507] Master 127.5.160.190:40651 requested a full tablet report, sending...
I20251211 15:02:44.901683 10456 ts_manager.cc:194] Registered new tserver with Master: eb1246d2b8ef4068866326a321350f80 (127.5.160.131:38757)
I20251211 15:02:44.902259 10456 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.131@KRBTEST.COM'} at 127.5.160.131:52355
I20251211 15:02:44.911459  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251211 15:02:44.919945 10495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:44.913314 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46156 (local address 127.5.160.190:40651)
1211 15:02:44.913512 (+   198us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:44.913517 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:44.913601 (+    84us) server_negotiation.cc:408] Connection header received
1211 15:02:44.913723 (+   122us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:44.913726 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:44.913773 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:44.913840 (+    67us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:44.914716 (+   876us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.915277 (+   561us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:44.915924 (+   647us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.916102 (+   178us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:44.917183 (+  1081us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:44.917205 (+    22us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:44.917209 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:02:44.917239 (+    30us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:44.918496 (+  1257us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:44.918860 (+   364us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:44.918863 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:44.918865 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:44.918910 (+    45us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:02:44.919148 (+   238us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:02:44.919151 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:02:44.919153 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:02:44.919341 (+   188us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:44.919480 (+   139us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:44.919673 (+   193us) server_negotiation.cc:300] Negotiation successful
1211 15:02:44.919788 (+   115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20251211 15:02:44.922559 10456 catalog_manager.cc:2257] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46156:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20251211 15:02:44.925030 10456 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:02:44.938261 10931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:44.934176 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:41351 (local address 127.0.0.1:54610)
1211 15:02:44.934989 (+   813us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:44.935002 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:44.935089 (+    87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:44.935606 (+   517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:44.935612 (+     6us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:44.935635 (+    23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:44.935933 (+   298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:44.935941 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.936957 (+  1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:44.936960 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:44.937741 (+   781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:44.937749 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.937849 (+   100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:44.937914 (+    65us) client_negotiation.cc:769] Sending connection context
1211 15:02:44.938006 (+    92us) client_negotiation.cc:240] Negotiation successful
1211 15:02:44.938104 (+    98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"thread_start_us":106,"threads_started":1}
I20251211 15:02:44.938716 10929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:44.933694 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:45737 (local address 127.0.0.1:37352)
1211 15:02:44.934772 (+  1078us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:44.934814 (+    42us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:44.934984 (+   170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:44.935872 (+   888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:44.935875 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:44.935890 (+    15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:44.936092 (+   202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:44.936100 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.937473 (+  1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:44.937477 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:44.938354 (+   877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:44.938364 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.938465 (+   101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:44.938483 (+    18us) client_negotiation.cc:769] Sending connection context
1211 15:02:44.938530 (+    47us) client_negotiation.cc:240] Negotiation successful
1211 15:02:44.938585 (+    55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"spinlock_wait_cycles":768,"thread_start_us":71,"threads_started":1}
I20251211 15:02:44.939049 10934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:44.934590 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54610 (local address 127.5.160.129:41351)
1211 15:02:44.934845 (+   255us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:44.934852 (+     7us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:44.935150 (+   298us) server_negotiation.cc:408] Connection header received
1211 15:02:44.935240 (+    90us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:44.935246 (+     6us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:44.935446 (+   200us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:44.935583 (+   137us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:44.936053 (+   470us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.936828 (+   775us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:44.937879 (+  1051us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.938654 (+   775us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:44.938748 (+    94us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:44.938807 (+    59us) server_negotiation.cc:300] Negotiation successful
1211 15:02:44.938903 (+    96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":82,"threads_started":1}
I20251211 15:02:44.939628 10933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:44.934433 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39236 (local address 127.5.160.131:38757)
1211 15:02:44.935314 (+   881us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:44.935320 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:44.935342 (+    22us) server_negotiation.cc:408] Connection header received
1211 15:02:44.935413 (+    71us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:44.935417 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:44.935537 (+   120us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:44.935664 (+   127us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:44.936122 (+   458us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.937261 (+  1139us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:44.938672 (+  1411us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.939208 (+   536us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:44.939321 (+   113us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:44.939382 (+    61us) server_negotiation.cc:300] Negotiation successful
1211 15:02:44.939480 (+    98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":724,"thread_start_us":112,"threads_started":1}
I20251211 15:02:44.939895 10932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:44.934326 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37352 (local address 127.5.160.130:45737)
1211 15:02:44.935395 (+  1069us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:44.935400 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:44.935420 (+    20us) server_negotiation.cc:408] Connection header received
1211 15:02:44.935494 (+    74us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:44.935499 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:44.935637 (+   138us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:44.935761 (+   124us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:44.936232 (+   471us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.937364 (+  1132us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:44.939018 (+  1654us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.939526 (+   508us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:44.939614 (+    88us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:44.939679 (+    65us) server_negotiation.cc:300] Negotiation successful
1211 15:02:44.939773 (+    94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":936,"thread_start_us":135,"threads_started":1}
I20251211 15:02:44.939937 10930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:44.933847 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:38757 (local address 127.0.0.1:39236)
1211 15:02:44.934772 (+   925us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:44.934814 (+    42us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:44.934984 (+   170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:44.935797 (+   813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:44.935801 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:44.935817 (+    16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:44.936021 (+   204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:44.936027 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.937402 (+  1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:44.937405 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:44.938354 (+   949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:44.938364 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:44.938465 (+   101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:44.938483 (+    18us) client_negotiation.cc:769] Sending connection context
1211 15:02:44.938530 (+    47us) client_negotiation.cc:240] Negotiation successful
1211 15:02:44.938585 (+    55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":821,"spinlock_wait_cycles":5888,"thread_start_us":95,"threads_started":1}
I20251211 15:02:44.942034 10582 tablet_service.cc:1505] Processing CreateTablet for tablet 9f83c7099f76458788e7411e63287155 (DEFAULT_TABLE table=test-table [id=fb2751a5955d47d598a5c54908b626c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:44.942265 10852 tablet_service.cc:1505] Processing CreateTablet for tablet 9f83c7099f76458788e7411e63287155 (DEFAULT_TABLE table=test-table [id=fb2751a5955d47d598a5c54908b626c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:44.942430 10717 tablet_service.cc:1505] Processing CreateTablet for tablet 9f83c7099f76458788e7411e63287155 (DEFAULT_TABLE table=test-table [id=fb2751a5955d47d598a5c54908b626c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:44.943090 10852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f83c7099f76458788e7411e63287155. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:44.943099 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f83c7099f76458788e7411e63287155. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:44.943184 10717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f83c7099f76458788e7411e63287155. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:44.948406 10935 tablet_bootstrap.cc:492] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80: Bootstrap starting.
I20251211 15:02:44.949692 10937 tablet_bootstrap.cc:492] T 9f83c7099f76458788e7411e63287155 P 9ba64233904941768f895a52afa8e986: Bootstrap starting.
I20251211 15:02:44.949695 10936 tablet_bootstrap.cc:492] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2: Bootstrap starting.
I20251211 15:02:44.950757 10935 tablet_bootstrap.cc:654] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:44.951475 10937 tablet_bootstrap.cc:654] T 9f83c7099f76458788e7411e63287155 P 9ba64233904941768f895a52afa8e986: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:44.951630 10936 tablet_bootstrap.cc:654] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:44.951659 10935 log.cc:826] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:44.952230 10937 log.cc:826] T 9f83c7099f76458788e7411e63287155 P 9ba64233904941768f895a52afa8e986: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:44.952346 10936 log.cc:826] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:44.953745 10935 tablet_bootstrap.cc:492] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80: No bootstrap required, opened a new log
I20251211 15:02:44.953802 10936 tablet_bootstrap.cc:492] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2: No bootstrap required, opened a new log
I20251211 15:02:44.953899 10937 tablet_bootstrap.cc:492] T 9f83c7099f76458788e7411e63287155 P 9ba64233904941768f895a52afa8e986: No bootstrap required, opened a new log
I20251211 15:02:44.953985 10936 ts_tablet_manager.cc:1403] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2: Time spent bootstrapping tablet: real 0.004s	user 0.003s	sys 0.000s
I20251211 15:02:44.953987 10935 ts_tablet_manager.cc:1403] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80: Time spent bootstrapping tablet: real 0.006s	user 0.000s	sys 0.005s
I20251211 15:02:44.954046 10937 ts_tablet_manager.cc:1403] T 9f83c7099f76458788e7411e63287155 P 9ba64233904941768f895a52afa8e986: Time spent bootstrapping tablet: real 0.004s	user 0.003s	sys 0.000s
I20251211 15:02:44.957161 10936 raft_consensus.cc:359] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4650732fefac4c4ab33cc62988ba78a2" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45737 } } peers { permanent_uuid: "eb1246d2b8ef4068866326a321350f80" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38757 } } peers { permanent_uuid: "9ba64233904941768f895a52afa8e986" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 41351 } }
I20251211 15:02:44.957159 10937 raft_consensus.cc:359] T 9f83c7099f76458788e7411e63287155 P 9ba64233904941768f895a52afa8e986 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4650732fefac4c4ab33cc62988ba78a2" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45737 } } peers { permanent_uuid: "eb1246d2b8ef4068866326a321350f80" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38757 } } peers { permanent_uuid: "9ba64233904941768f895a52afa8e986" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 41351 } }
I20251211 15:02:44.957361 10936 raft_consensus.cc:385] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:44.957371 10937 raft_consensus.cc:385] T 9f83c7099f76458788e7411e63287155 P 9ba64233904941768f895a52afa8e986 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:44.957409 10936 raft_consensus.cc:740] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4650732fefac4c4ab33cc62988ba78a2, State: Initialized, Role: FOLLOWER
I20251211 15:02:44.957435 10937 raft_consensus.cc:740] T 9f83c7099f76458788e7411e63287155 P 9ba64233904941768f895a52afa8e986 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba64233904941768f895a52afa8e986, State: Initialized, Role: FOLLOWER
I20251211 15:02:44.957481 10935 raft_consensus.cc:359] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4650732fefac4c4ab33cc62988ba78a2" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45737 } } peers { permanent_uuid: "eb1246d2b8ef4068866326a321350f80" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38757 } } peers { permanent_uuid: "9ba64233904941768f895a52afa8e986" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 41351 } }
I20251211 15:02:44.957662 10935 raft_consensus.cc:385] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:44.957716 10935 raft_consensus.cc:740] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb1246d2b8ef4068866326a321350f80, State: Initialized, Role: FOLLOWER
I20251211 15:02:44.957847 10936 consensus_queue.cc:260] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4650732fefac4c4ab33cc62988ba78a2" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45737 } } peers { permanent_uuid: "eb1246d2b8ef4068866326a321350f80" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38757 } } peers { permanent_uuid: "9ba64233904941768f895a52afa8e986" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 41351 } }
I20251211 15:02:44.957933 10937 consensus_queue.cc:260] T 9f83c7099f76458788e7411e63287155 P 9ba64233904941768f895a52afa8e986 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4650732fefac4c4ab33cc62988ba78a2" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45737 } } peers { permanent_uuid: "eb1246d2b8ef4068866326a321350f80" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38757 } } peers { permanent_uuid: "9ba64233904941768f895a52afa8e986" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 41351 } }
I20251211 15:02:44.958065 10935 consensus_queue.cc:260] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4650732fefac4c4ab33cc62988ba78a2" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45737 } } peers { permanent_uuid: "eb1246d2b8ef4068866326a321350f80" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38757 } } peers { permanent_uuid: "9ba64233904941768f895a52afa8e986" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 41351 } }
I20251211 15:02:44.958542 10783 heartbeater.cc:499] Master 127.5.160.190:40651 was elected leader, sending a full tablet report...
I20251211 15:02:44.958743 10936 ts_tablet_manager.cc:1434] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20251211 15:02:44.958746 10935 ts_tablet_manager.cc:1434] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20251211 15:02:44.958746 10937 ts_tablet_manager.cc:1434] T 9f83c7099f76458788e7411e63287155 P 9ba64233904941768f895a52afa8e986: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20251211 15:02:44.959102 10918 heartbeater.cc:499] Master 127.5.160.190:40651 was elected leader, sending a full tablet report...
I20251211 15:02:44.959103 10648 heartbeater.cc:499] Master 127.5.160.190:40651 was elected leader, sending a full tablet report...
I20251211 15:02:45.007077 10941 raft_consensus.cc:493] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:02:45.007293 10941 raft_consensus.cc:515] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4650732fefac4c4ab33cc62988ba78a2" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45737 } } peers { permanent_uuid: "eb1246d2b8ef4068866326a321350f80" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38757 } } peers { permanent_uuid: "9ba64233904941768f895a52afa8e986" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 41351 } }
I20251211 15:02:45.008615 10941 leader_election.cc:290] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb1246d2b8ef4068866326a321350f80 (127.5.160.131:38757), 9ba64233904941768f895a52afa8e986 (127.5.160.129:41351)
I20251211 15:02:45.011673 10785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.008827 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:38757 (local address 127.5.160.130:42415)
1211 15:02:45.009025 (+   198us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:45.009040 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:45.009147 (+   107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:45.009423 (+   276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:45.009426 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:45.009445 (+    19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:45.009707 (+   262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:45.009714 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:45.010511 (+   797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:45.010515 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:45.011366 (+   851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:45.011375 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:45.011465 (+    90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:45.011485 (+    20us) client_negotiation.cc:769] Sending connection context
1211 15:02:45.011517 (+    32us) client_negotiation.cc:240] Negotiation successful
1211 15:02:45.011569 (+    52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116}
I20251211 15:02:45.012317 10933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.008919 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:42415 (local address 127.5.160.131:38757)
1211 15:02:45.009042 (+   123us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:45.009047 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:45.009115 (+    68us) server_negotiation.cc:408] Connection header received
1211 15:02:45.009259 (+   144us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:45.009263 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:45.009322 (+    59us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:45.009412 (+    90us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:45.009818 (+   406us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:45.010388 (+   570us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:45.011497 (+  1109us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:45.012016 (+   519us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:45.012059 (+    43us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:45.012115 (+    56us) server_negotiation.cc:300] Negotiation successful
1211 15:02:45.012191 (+    76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20251211 15:02:45.012718 10944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.008856 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:41351 (local address 127.5.160.130:56799)
1211 15:02:45.009209 (+   353us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:45.009222 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:45.009326 (+   104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:45.009587 (+   261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:45.009589 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:45.009610 (+    21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:02:45.009868 (+   258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:45.009876 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:45.011222 (+  1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:45.011225 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:45.012044 (+   819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:45.012055 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:45.012200 (+   145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:45.012218 (+    18us) client_negotiation.cc:769] Sending connection context
1211 15:02:45.012272 (+    54us) client_negotiation.cc:240] Negotiation successful
1211 15:02:45.012331 (+    59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":115,"threads_started":1}
I20251211 15:02:45.012885 10934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.008964 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:56799 (local address 127.5.160.129:41351)
1211 15:02:45.009076 (+   112us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:45.009080 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:45.009302 (+   222us) server_negotiation.cc:408] Connection header received
1211 15:02:45.009425 (+   123us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:45.009428 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:45.009486 (+    58us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:45.009566 (+    80us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:02:45.010028 (+   462us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:45.011035 (+  1007us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:45.012233 (+  1198us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:45.012644 (+   411us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:45.012676 (+    32us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:45.012721 (+    45us) server_negotiation.cc:300] Negotiation successful
1211 15:02:45.012767 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20251211 15:02:45.012986 10872 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f83c7099f76458788e7411e63287155" candidate_uuid: "4650732fefac4c4ab33cc62988ba78a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb1246d2b8ef4068866326a321350f80" is_pre_election: true
I20251211 15:02:45.013298 10872 raft_consensus.cc:2468] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4650732fefac4c4ab33cc62988ba78a2 in term 0.
I20251211 15:02:45.013408 10602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f83c7099f76458788e7411e63287155" candidate_uuid: "4650732fefac4c4ab33cc62988ba78a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba64233904941768f895a52afa8e986" is_pre_election: true
I20251211 15:02:45.013641 10602 raft_consensus.cc:2468] T 9f83c7099f76458788e7411e63287155 P 9ba64233904941768f895a52afa8e986 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4650732fefac4c4ab33cc62988ba78a2 in term 0.
I20251211 15:02:45.013813 10672 leader_election.cc:304] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4650732fefac4c4ab33cc62988ba78a2, eb1246d2b8ef4068866326a321350f80; no voters: 
I20251211 15:02:45.014060 10941 raft_consensus.cc:2804] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:02:45.014144 10941 raft_consensus.cc:493] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:02:45.014189 10941 raft_consensus.cc:3060] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:45.015296 10941 raft_consensus.cc:515] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4650732fefac4c4ab33cc62988ba78a2" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45737 } } peers { permanent_uuid: "eb1246d2b8ef4068866326a321350f80" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38757 } } peers { permanent_uuid: "9ba64233904941768f895a52afa8e986" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 41351 } }
I20251211 15:02:45.015687 10941 leader_election.cc:290] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [CANDIDATE]: Term 1 election: Requested vote from peers eb1246d2b8ef4068866326a321350f80 (127.5.160.131:38757), 9ba64233904941768f895a52afa8e986 (127.5.160.129:41351)
I20251211 15:02:45.016073 10602 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f83c7099f76458788e7411e63287155" candidate_uuid: "4650732fefac4c4ab33cc62988ba78a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba64233904941768f895a52afa8e986"
I20251211 15:02:45.016243 10602 raft_consensus.cc:3060] T 9f83c7099f76458788e7411e63287155 P 9ba64233904941768f895a52afa8e986 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:45.017277 10602 raft_consensus.cc:2468] T 9f83c7099f76458788e7411e63287155 P 9ba64233904941768f895a52afa8e986 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4650732fefac4c4ab33cc62988ba78a2 in term 1.
I20251211 15:02:45.017562 10872 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f83c7099f76458788e7411e63287155" candidate_uuid: "4650732fefac4c4ab33cc62988ba78a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb1246d2b8ef4068866326a321350f80"
I20251211 15:02:45.017632 10671 leader_election.cc:304] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4650732fefac4c4ab33cc62988ba78a2, 9ba64233904941768f895a52afa8e986; no voters: 
I20251211 15:02:45.017695 10872 raft_consensus.cc:3060] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:45.017802 10941 raft_consensus.cc:2804] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:45.018047 10941 raft_consensus.cc:697] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [term 1 LEADER]: Becoming Leader. State: Replica: 4650732fefac4c4ab33cc62988ba78a2, State: Running, Role: LEADER
I20251211 15:02:45.018405 10941 consensus_queue.cc:237] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4650732fefac4c4ab33cc62988ba78a2" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45737 } } peers { permanent_uuid: "eb1246d2b8ef4068866326a321350f80" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38757 } } peers { permanent_uuid: "9ba64233904941768f895a52afa8e986" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 41351 } }
I20251211 15:02:45.018860 10872 raft_consensus.cc:2468] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4650732fefac4c4ab33cc62988ba78a2 in term 1.
I20251211 15:02:45.021726 10454 catalog_manager.cc:5654] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4650732fefac4c4ab33cc62988ba78a2 (127.5.160.130). New cstate: current_term: 1 leader_uuid: "4650732fefac4c4ab33cc62988ba78a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4650732fefac4c4ab33cc62988ba78a2" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb1246d2b8ef4068866326a321350f80" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba64233904941768f895a52afa8e986" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 41351 } health_report { overall_health: UNKNOWN } } }
I20251211 15:02:45.044456 10932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.041531 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37360 (local address 127.5.160.130:45737)
1211 15:02:45.041646 (+   115us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:45.041649 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:45.041661 (+    12us) server_negotiation.cc:408] Connection header received
1211 15:02:45.041735 (+    74us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:45.041738 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:45.041795 (+    57us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:45.041880 (+    85us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:02:45.042224 (+   344us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:45.042736 (+   512us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:45.043442 (+   706us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:45.043598 (+   156us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:45.043690 (+    92us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:02:45.044163 (+   473us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:02:45.044263 (+   100us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:45.044291 (+    28us) server_negotiation.cc:300] Negotiation successful
1211 15:02:45.044348 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20251211 15:02:45.049896 10602 raft_consensus.cc:1275] T 9f83c7099f76458788e7411e63287155 P 9ba64233904941768f895a52afa8e986 [term 1 FOLLOWER]: Refusing update from remote peer 4650732fefac4c4ab33cc62988ba78a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:45.049896 10872 raft_consensus.cc:1275] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80 [term 1 FOLLOWER]: Refusing update from remote peer 4650732fefac4c4ab33cc62988ba78a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:45.050523 10941 consensus_queue.cc:1048] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba64233904941768f895a52afa8e986" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:45.050701 10945 consensus_queue.cc:1048] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb1246d2b8ef4068866326a321350f80" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 38757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:45.058287 10949 mvcc.cc:204] Tried to move back new op lower bound from 7231346135237410816 to 7231346135118553088. Current Snapshot: MvccSnapshot[applied={T|T < 7231346135237410816}]
I20251211 15:02:45.065376 10455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46156:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:45.065565 10455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46156:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:45.068061 10455 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 10e4914db0474beb9b5f59ee66d88d62: Sending DeleteTablet for 3 replicas of tablet 9f83c7099f76458788e7411e63287155
I20251211 15:02:45.068838 10852 tablet_service.cc:1552] Processing DeleteTablet for tablet 9f83c7099f76458788e7411e63287155 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:45 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:39236
I20251211 15:02:45.068945 10717 tablet_service.cc:1552] Processing DeleteTablet for tablet 9f83c7099f76458788e7411e63287155 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:45 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:37352
I20251211 15:02:45.069229 10582 tablet_service.cc:1552] Processing DeleteTablet for tablet 9f83c7099f76458788e7411e63287155 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:45 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:54610
I20251211 15:02:45.069366 10958 tablet_replica.cc:333] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80: stopping tablet replica
I20251211 15:02:45.069633 10960 tablet_replica.cc:333] T 9f83c7099f76458788e7411e63287155 P 9ba64233904941768f895a52afa8e986: stopping tablet replica
I20251211 15:02:45.069638 10958 raft_consensus.cc:2243] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:02:45.069962 10958 raft_consensus.cc:2272] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:45.070007  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 10520
I20251211 15:02:45.072415 10958 ts_tablet_manager.cc:1916] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:45.075078 10958 ts_tablet_manager.cc:1929] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:02:45.075191 10958 log.cc:1199] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1765465326787564-5762-0/minicluster-data/ts-2/wal/wals/9f83c7099f76458788e7411e63287155
I20251211 15:02:45.075320 10959 tablet_replica.cc:333] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2: stopping tablet replica
I20251211 15:02:45.075516 10958 ts_tablet_manager.cc:1950] T 9f83c7099f76458788e7411e63287155 P eb1246d2b8ef4068866326a321350f80: Deleting consensus metadata
I20251211 15:02:45.075736 10959 raft_consensus.cc:2243] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [term 1 LEADER]: Raft consensus shutting down.
W20251211 15:02:45.076092 10441 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.160.129:41351 (error 108)
I20251211 15:02:45.076153 10959 raft_consensus.cc:2272] T 9f83c7099f76458788e7411e63287155 P 4650732fefac4c4ab33cc62988ba78a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:45.076781 10442 catalog_manager.cc:4985] TS eb1246d2b8ef4068866326a321350f80 (127.5.160.131:38757): tablet 9f83c7099f76458788e7411e63287155 (table test-table [id=fb2751a5955d47d598a5c54908b626c5]) successfully deleted
I20251211 15:02:45.077411  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 10655
I20251211 15:02:45.077476 10930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.077170 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:41351 (local address 127.0.0.1:54626)
1211 15:02:45.077317 (+   147us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:45.077388 (+    71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.129:41351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20251211 15:02:45.077909 10441 catalog_manager.cc:4712] TS 9ba64233904941768f895a52afa8e986 (127.5.160.129:41351): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9f83c7099f76458788e7411e63287155: Network error: Client connection negotiation failed: client connection to 127.5.160.129:41351: connect: Connection refused (error 111)
I20251211 15:02:45.082628  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 10790
I20251211 15:02:45.083990 10930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.082883 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:45737 (local address 127.0.0.1:37376)
1211 15:02:45.083840 (+   957us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:45.083894 (+    54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.130:45737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":863}
I20251211 15:02:45.087620  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 10425
2025-12-11T15:02:45Z chronyd exiting
[       OK ] SecurityITest.TestDisableWebUI (3083 ms)
[ RUN      ] SecurityITest.TestDisableAuthenticationEncryption
2025-12-11T15:02:45Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:02:45Z Disabled control of system clock
I20251211 15:02:45.115891  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40565
--webserver_interface=127.5.160.190
--webserver_port=0
--builtin_ntp_servers=127.5.160.148:34215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:40565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20251211 15:02:45.223264 10965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:45.223511 10965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:45.223559 10965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:45.226819 10965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:02:45.226887 10965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:45.226902 10965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:45.226922 10965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:02:45.226960 10965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:02:45.230996 10965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:34215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:40565
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:45.232013 10965 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:45.233076 10965 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:45.238831 10971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:45.238888 10965 server_base.cc:1047] running on GCE node
W20251211 15:02:45.238790 10970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:45.238790 10973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:45.239732 10965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:45.240734 10965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:45.241883 10965 hybrid_clock.cc:648] HybridClock initialized: now 1765465365241867 us; error 37 us; skew 500 ppm
I20251211 15:02:45.243796 10965 webserver.cc:492] Webserver started at http://127.5.160.190:40381/ using document root <none> and password file <none>
I20251211 15:02:45.244340 10965 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:45.244400 10965 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:45.244575 10965 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:45.246243 10965 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "4b4fe1c1277643a082f350d7a7c603f6"
format_stamp: "Formatted at 2025-12-11 15:02:45 on dist-test-slave-4k3m"
server_key: "21f6cff2af66cdfc1b1b08c170193cc0"
server_key_iv: "132fddc1b40f99b87d12f40e8d2c4256"
server_key_version: "encryptionkey@0"
I20251211 15:02:45.246707 10965 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "4b4fe1c1277643a082f350d7a7c603f6"
format_stamp: "Formatted at 2025-12-11 15:02:45 on dist-test-slave-4k3m"
server_key: "21f6cff2af66cdfc1b1b08c170193cc0"
server_key_iv: "132fddc1b40f99b87d12f40e8d2c4256"
server_key_version: "encryptionkey@0"
I20251211 15:02:45.249941 10965 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20251211 15:02:45.252388 10979 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:45.253517 10965 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:02:45.253633 10965 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "4b4fe1c1277643a082f350d7a7c603f6"
format_stamp: "Formatted at 2025-12-11 15:02:45 on dist-test-slave-4k3m"
server_key: "21f6cff2af66cdfc1b1b08c170193cc0"
server_key_iv: "132fddc1b40f99b87d12f40e8d2c4256"
server_key_version: "encryptionkey@0"
I20251211 15:02:45.253728 10965 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:45.258432 10965 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:45.259004 10965 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:45.259146 10965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:45.265918 10965 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:40565
I20251211 15:02:45.265914 11031 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:40565 every 8 connection(s)
I20251211 15:02:45.266958 10965 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:02:45.269637 11032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:45.271128  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 10965
I20251211 15:02:45.271240  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:02:45.271451  5762 external_mini_cluster.cc:1468] Setting key 0bdce5d8854ce7d6313122eb5a3316ea
I20251211 15:02:45.275353 11032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6: Bootstrap starting.
I20251211 15:02:45.276286 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.272692 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36954 (local address 127.5.160.190:40565)
1211 15:02:45.273315 (+   623us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:45.273323 (+     8us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:45.273356 (+    33us) server_negotiation.cc:408] Connection header received
1211 15:02:45.273872 (+   516us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:45.273888 (+    16us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:45.274175 (+   287us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:45.274465 (+   290us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:45.275246 (+   781us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:45.275251 (+     5us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:45.275261 (+    10us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:02:45.275270 (+     9us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:45.275309 (+    39us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:02:45.275320 (+    11us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:45.275473 (+   153us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:45.275568 (+    95us) server_negotiation.cc:300] Negotiation successful
1211 15:02:45.275768 (+   200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":118,"threads_started":1}
I20251211 15:02:45.277598 11032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:45.278339 11032 log.cc:826] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:45.280095 11032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6: No bootstrap required, opened a new log
I20251211 15:02:45.282469 11032 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b4fe1c1277643a082f350d7a7c603f6" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40565 } }
I20251211 15:02:45.282652 11032 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:45.282714 11032 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b4fe1c1277643a082f350d7a7c603f6, State: Initialized, Role: FOLLOWER
I20251211 15:02:45.283285 11032 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b4fe1c1277643a082f350d7a7c603f6" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40565 } }
I20251211 15:02:45.283445 11032 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:02:45.283510 11032 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:02:45.283599 11032 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:45.284405 11032 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b4fe1c1277643a082f350d7a7c603f6" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40565 } }
I20251211 15:02:45.284749 11032 leader_election.cc:304] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b4fe1c1277643a082f350d7a7c603f6; no voters: 
I20251211 15:02:45.285030 11032 leader_election.cc:290] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:02:45.285113 11037 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:45.285316 11037 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [term 1 LEADER]: Becoming Leader. State: Replica: 4b4fe1c1277643a082f350d7a7c603f6, State: Running, Role: LEADER
I20251211 15:02:45.285629 11037 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b4fe1c1277643a082f350d7a7c603f6" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40565 } }
I20251211 15:02:45.286154 11032 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:02:45.287151 11038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b4fe1c1277643a082f350d7a7c603f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b4fe1c1277643a082f350d7a7c603f6" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40565 } } }
I20251211 15:02:45.287268 11038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:45.287672 11046 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:02:45.287675 11039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b4fe1c1277643a082f350d7a7c603f6. Latest consensus state: current_term: 1 leader_uuid: "4b4fe1c1277643a082f350d7a7c603f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b4fe1c1277643a082f350d7a7c603f6" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40565 } } }
I20251211 15:02:45.287772 11039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:45.290776 11046 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:02:45.296260 11046 catalog_manager.cc:1357] Generated new cluster ID: 6ff6ef00f29a48e1baf2a2c2d2af4669
I20251211 15:02:45.296346 11046 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:02:45.333053 11046 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:02:45.333429 11046 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:02:45.341593 11046 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6: Generated new TSK 0
I20251211 15:02:45.342520 11046 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 15:02:45.353827  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40565
--builtin_ntp_servers=127.5.160.148:34215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20251211 15:02:45.461913 11056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:45.462149 11056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:45.462231 11056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:45.465590 11056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:45.465659 11056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:45.465762 11056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:02:45.469662 11056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:34215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:45.470804 11056 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:45.471998 11056 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:45.478545 11064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:45.478592 11061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:45.478557 11062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:45.478787 11056 server_base.cc:1047] running on GCE node
I20251211 15:02:45.479281 11056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:45.479821 11056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:45.480971 11056 hybrid_clock.cc:648] HybridClock initialized: now 1765465365480946 us; error 40 us; skew 500 ppm
I20251211 15:02:45.482784 11056 webserver.cc:492] Webserver started at http://127.5.160.129:35055/ using document root <none> and password file <none>
I20251211 15:02:45.483389 11056 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:45.483453 11056 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:45.483632 11056 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:45.485306 11056 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "6241150b20924ae7953ed2eb4e7e66f6"
format_stamp: "Formatted at 2025-12-11 15:02:45 on dist-test-slave-4k3m"
server_key: "a3c470168755c90f7da5807a1df53f29"
server_key_iv: "a7cc0621c6559c538df9500f114ea63e"
server_key_version: "encryptionkey@0"
I20251211 15:02:45.485772 11056 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "6241150b20924ae7953ed2eb4e7e66f6"
format_stamp: "Formatted at 2025-12-11 15:02:45 on dist-test-slave-4k3m"
server_key: "a3c470168755c90f7da5807a1df53f29"
server_key_iv: "a7cc0621c6559c538df9500f114ea63e"
server_key_version: "encryptionkey@0"
I20251211 15:02:45.489223 11056 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.004s
I20251211 15:02:45.491591 11070 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:45.492594 11056 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:02:45.492698 11056 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "6241150b20924ae7953ed2eb4e7e66f6"
format_stamp: "Formatted at 2025-12-11 15:02:45 on dist-test-slave-4k3m"
server_key: "a3c470168755c90f7da5807a1df53f29"
server_key_iv: "a7cc0621c6559c538df9500f114ea63e"
server_key_version: "encryptionkey@0"
I20251211 15:02:45.492785 11056 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:45.497483 11056 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:45.498054 11056 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:45.498211 11056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:45.498713 11056 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:45.499682 11056 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:45.499732 11056 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:45.499779 11056 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:45.499804 11056 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:45.508404 11056 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:34739
I20251211 15:02:45.508440 11183 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:34739 every 8 connection(s)
I20251211 15:02:45.509390 11056 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:02:45.514680 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.511167 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:46285 (local address 127.5.160.190:40565)
1211 15:02:45.511300 (+   133us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:45.511304 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:45.512218 (+   914us) server_negotiation.cc:408] Connection header received
1211 15:02:45.512982 (+   764us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:45.512986 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:45.513033 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:45.513114 (+    81us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:45.514219 (+  1105us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:45.514223 (+     4us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:45.514227 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:02:45.514241 (+    14us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:45.514261 (+    20us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:02:45.514269 (+     8us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:45.514351 (+    82us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:45.514495 (+   144us) server_negotiation.cc:300] Negotiation successful
1211 15:02:45.514543 (+    48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20251211 15:02:45.515424 11186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.511448 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40565 (local address 127.5.160.129:46285)
1211 15:02:45.512072 (+   624us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:45.512107 (+    35us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:45.512796 (+   689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:45.513271 (+   475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:45.513279 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:45.513380 (+   101us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:45.513928 (+   548us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
1211 15:02:45.513930 (+     2us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:45.513962 (+    32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
1211 15:02:45.514016 (+    54us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:45.514342 (+   326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:45.514349 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:45.514355 (+     6us) client_negotiation.cc:769] Sending connection context
1211 15:02:45.514543 (+   188us) client_negotiation.cc:240] Negotiation successful
1211 15:02:45.514765 (+   222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":100,"threads_started":1}
I20251211 15:02:45.516506 11184 heartbeater.cc:344] Connected to a master server at 127.5.160.190:40565
I20251211 15:02:45.516717 11184 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:45.517083 11184 heartbeater.cc:507] Master 127.5.160.190:40565 requested a full tablet report, sending...
I20251211 15:02:45.518440 10996 ts_manager.cc:194] Registered new tserver with Master: 6241150b20924ae7953ed2eb4e7e66f6 (127.5.160.129:34739)
I20251211 15:02:45.519685  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 11056
I20251211 15:02:45.519802  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:02:45.520068  5762 external_mini_cluster.cc:1468] Setting key 89ee5a3cad7fe325578faa5037df1503
I20251211 15:02:45.521798  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40565
--builtin_ntp_servers=127.5.160.148:34215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20251211 15:02:45.625233 11187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:45.625468 11187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:45.625519 11187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:45.628808 11187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:45.628871 11187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:45.628952 11187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:02:45.632797 11187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:34215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:45.633884 11187 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:45.635015 11187 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:45.641707 11195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:45.641702 11192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:45.641799 11187 server_base.cc:1047] running on GCE node
W20251211 15:02:45.641711 11193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:45.642338 11187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:45.642979 11187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:45.644214 11187 hybrid_clock.cc:648] HybridClock initialized: now 1765465365644188 us; error 39 us; skew 500 ppm
I20251211 15:02:45.645972 11187 webserver.cc:492] Webserver started at http://127.5.160.130:36299/ using document root <none> and password file <none>
I20251211 15:02:45.646540 11187 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:45.646611 11187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:45.646795 11187 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:45.648460 11187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "5e9cf06be59c4645b0eadc29d0ab2b47"
format_stamp: "Formatted at 2025-12-11 15:02:45 on dist-test-slave-4k3m"
server_key: "4cdd465b5abcfd592fa39b8f4831d15b"
server_key_iv: "c2877ee77d84fb8c8830b54fea4018ea"
server_key_version: "encryptionkey@0"
I20251211 15:02:45.648919 11187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "5e9cf06be59c4645b0eadc29d0ab2b47"
format_stamp: "Formatted at 2025-12-11 15:02:45 on dist-test-slave-4k3m"
server_key: "4cdd465b5abcfd592fa39b8f4831d15b"
server_key_iv: "c2877ee77d84fb8c8830b54fea4018ea"
server_key_version: "encryptionkey@0"
I20251211 15:02:45.652323 11187 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.002s
I20251211 15:02:45.654469 11201 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:45.655553 11187 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20251211 15:02:45.655663 11187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "5e9cf06be59c4645b0eadc29d0ab2b47"
format_stamp: "Formatted at 2025-12-11 15:02:45 on dist-test-slave-4k3m"
server_key: "4cdd465b5abcfd592fa39b8f4831d15b"
server_key_iv: "c2877ee77d84fb8c8830b54fea4018ea"
server_key_version: "encryptionkey@0"
I20251211 15:02:45.655752 11187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:45.660591 11187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:45.661165 11187 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:45.661324 11187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:45.661834 11187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:45.662763 11187 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:45.662810 11187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:45.662860 11187 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:45.662885 11187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:45.671283 11187 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:38511
I20251211 15:02:45.671341 11314 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:38511 every 8 connection(s)
I20251211 15:02:45.672242 11187 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:02:45.677150  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 11187
I20251211 15:02:45.677287  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:02:45.677592  5762 external_mini_cluster.cc:1468] Setting key 66f76c717096d7730589b1a5621bfb71
I20251211 15:02:45.678067 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.673952 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:40681 (local address 127.5.160.190:40565)
1211 15:02:45.674104 (+   152us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:45.674109 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:45.675001 (+   892us) server_negotiation.cc:408] Connection header received
1211 15:02:45.675838 (+   837us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:45.675841 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:45.675889 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:45.675976 (+    87us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:45.677037 (+  1061us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:45.677040 (+     3us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:45.677042 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:02:45.677054 (+    12us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:45.677075 (+    21us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:02:45.677083 (+     8us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:45.677159 (+    76us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:45.677878 (+   719us) server_negotiation.cc:300] Negotiation successful
1211 15:02:45.677928 (+    50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20251211 15:02:45.678876 11317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.674218 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40565 (local address 127.5.160.130:40681)
1211 15:02:45.674847 (+   629us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:45.674881 (+    34us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:45.675602 (+   721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:45.676115 (+   513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:45.676123 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:45.676218 (+    95us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:45.676760 (+   542us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
1211 15:02:45.676762 (+     2us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:45.676794 (+    32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
1211 15:02:45.676881 (+    87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:45.677717 (+   836us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:45.677724 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:45.677728 (+     4us) client_negotiation.cc:769] Sending connection context
1211 15:02:45.677922 (+   194us) client_negotiation.cc:240] Negotiation successful
1211 15:02:45.678139 (+   217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":96,"threads_started":1}
I20251211 15:02:45.679772  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40565
--builtin_ntp_servers=127.5.160.148:34215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20251211 15:02:45.679986 11315 heartbeater.cc:344] Connected to a master server at 127.5.160.190:40565
I20251211 15:02:45.680212 11315 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:45.680599 11315 heartbeater.cc:507] Master 127.5.160.190:40565 requested a full tablet report, sending...
I20251211 15:02:45.681493 10996 ts_manager.cc:194] Registered new tserver with Master: 5e9cf06be59c4645b0eadc29d0ab2b47 (127.5.160.130:38511)
W20251211 15:02:45.789247 11318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:45.789492 11318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:45.789548 11318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:45.792992 11318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:45.793062 11318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:45.793148 11318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:02:45.797183 11318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:34215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:45.798283 11318 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:45.799484 11318 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:45.806324 11324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:45.806329 11326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:45.806521 11318 server_base.cc:1047] running on GCE node
W20251211 15:02:45.806303 11323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:45.806922 11318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:45.807533 11318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:45.808725 11318 hybrid_clock.cc:648] HybridClock initialized: now 1765465365808704 us; error 36 us; skew 500 ppm
I20251211 15:02:45.810664 11318 webserver.cc:492] Webserver started at http://127.5.160.131:40581/ using document root <none> and password file <none>
I20251211 15:02:45.811281 11318 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:45.811336 11318 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:45.811508 11318 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:45.813189 11318 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "a894acac3d1d43128ea11da23c970f1f"
format_stamp: "Formatted at 2025-12-11 15:02:45 on dist-test-slave-4k3m"
server_key: "f4e85ab5c30f6a101dc6dcde268997dc"
server_key_iv: "b97d0ddb850b5e5775b0648fbfd4f821"
server_key_version: "encryptionkey@0"
I20251211 15:02:45.813620 11318 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "a894acac3d1d43128ea11da23c970f1f"
format_stamp: "Formatted at 2025-12-11 15:02:45 on dist-test-slave-4k3m"
server_key: "f4e85ab5c30f6a101dc6dcde268997dc"
server_key_iv: "b97d0ddb850b5e5775b0648fbfd4f821"
server_key_version: "encryptionkey@0"
I20251211 15:02:45.816874 11318 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20251211 15:02:45.819047 11332 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:45.820086 11318 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:02:45.820202 11318 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "a894acac3d1d43128ea11da23c970f1f"
format_stamp: "Formatted at 2025-12-11 15:02:45 on dist-test-slave-4k3m"
server_key: "f4e85ab5c30f6a101dc6dcde268997dc"
server_key_iv: "b97d0ddb850b5e5775b0648fbfd4f821"
server_key_version: "encryptionkey@0"
I20251211 15:02:45.820293 11318 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:45.825212 11318 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:45.825800 11318 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:45.825954 11318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:45.826473 11318 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:02:45.827620 11318 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:02:45.827679 11318 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:45.827737 11318 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:02:45.827767 11318 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:45.836431 11318 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:34055
I20251211 15:02:45.836467 11445 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:34055 every 8 connection(s)
I20251211 15:02:45.837378 11318 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
I20251211 15:02:45.842828 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.839165 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:43285 (local address 127.5.160.190:40565)
1211 15:02:45.839318 (+   153us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:45.839322 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:45.840329 (+  1007us) server_negotiation.cc:408] Connection header received
1211 15:02:45.841189 (+   860us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:45.841193 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:45.841238 (+    45us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:45.841336 (+    98us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:45.842406 (+  1070us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:45.842410 (+     4us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:45.842412 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:02:45.842423 (+    11us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:45.842445 (+    22us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:02:45.842453 (+     8us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:45.842532 (+    79us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:45.842688 (+   156us) server_negotiation.cc:300] Negotiation successful
1211 15:02:45.842722 (+    34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20251211 15:02:45.843600 11448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.839452 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40565 (local address 127.5.160.131:43285)
1211 15:02:45.840103 (+   651us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:45.840153 (+    50us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:45.841006 (+   853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:45.841525 (+   519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:45.841533 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:45.841637 (+   104us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:45.842173 (+   536us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
1211 15:02:45.842175 (+     2us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:45.842208 (+    33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
1211 15:02:45.842269 (+    61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:45.842554 (+   285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:45.842561 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:45.842565 (+     4us) client_negotiation.cc:769] Sending connection context
1211 15:02:45.842735 (+   170us) client_negotiation.cc:240] Negotiation successful
1211 15:02:45.842921 (+   186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":98,"threads_started":1}
I20251211 15:02:45.844697 11446 heartbeater.cc:344] Connected to a master server at 127.5.160.190:40565
I20251211 15:02:45.844925 11446 heartbeater.cc:461] Registering TS with master...
I20251211 15:02:45.845299  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 11318
I20251211 15:02:45.845438  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:02:45.845449 11446 heartbeater.cc:507] Master 127.5.160.190:40565 requested a full tablet report, sending...
I20251211 15:02:45.845705  5762 external_mini_cluster.cc:1468] Setting key dec2709fe925403a37ecf6f40ca3bdf6
I20251211 15:02:45.846540 10995 ts_manager.cc:194] Registered new tserver with Master: a894acac3d1d43128ea11da23c970f1f (127.5.160.131:34055)
I20251211 15:02:45.847630  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251211 15:02:45.850979 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.849531 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36958 (local address 127.5.160.190:40565)
1211 15:02:45.849636 (+   105us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:45.849640 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:45.849752 (+   112us) server_negotiation.cc:408] Connection header received
1211 15:02:45.849858 (+   106us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:45.849860 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:45.849892 (+    32us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:45.849947 (+    55us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:45.850634 (+   687us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:45.850637 (+     3us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:45.850640 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:02:45.850652 (+    12us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:45.850673 (+    21us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:02:45.850683 (+    10us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:45.850767 (+    84us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:45.850815 (+    48us) server_negotiation.cc:300] Negotiation successful
1211 15:02:45.850847 (+    32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20251211 15:02:45.853539 10996 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36958:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20251211 15:02:45.856031 10996 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:02:45.867231 11461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.864738 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36348 (local address 127.5.160.130:38511)
1211 15:02:45.865114 (+   376us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:45.865120 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:45.865144 (+    24us) server_negotiation.cc:408] Connection header received
1211 15:02:45.865201 (+    57us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:45.865205 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:45.865361 (+   156us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:45.865487 (+   126us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:45.866719 (+  1232us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:45.866724 (+     5us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:45.866732 (+     8us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:02:45.866741 (+     9us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:45.866785 (+    44us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:02:45.866794 (+     9us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:45.866895 (+   101us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:45.867023 (+   128us) server_negotiation.cc:300] Negotiation successful
1211 15:02:45.867090 (+    67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":116,"threads_started":1}
I20251211 15:02:45.867216 11459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.864165 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:38511 (local address 127.0.0.1:36348)
1211 15:02:45.864918 (+   753us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:45.864957 (+    39us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:45.865061 (+   104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:45.865514 (+   453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:45.865520 (+     6us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:45.865585 (+    65us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:45.866547 (+   962us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
1211 15:02:45.866550 (+     3us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:45.866561 (+    11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
1211 15:02:45.866585 (+    24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:45.866872 (+   287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:45.866880 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:45.866885 (+     5us) client_negotiation.cc:769] Sending connection context
1211 15:02:45.867012 (+   127us) client_negotiation.cc:240] Negotiation successful
1211 15:02:45.867073 (+    61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":103,"threads_started":1}
I20251211 15:02:45.867384 11457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.863986 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:34739 (local address 127.0.0.1:51200)
1211 15:02:45.865242 (+  1256us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:45.865256 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:45.865336 (+    80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:45.865757 (+   421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:45.865761 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:45.865773 (+    12us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:45.866225 (+   452us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
1211 15:02:45.866228 (+     3us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:45.866264 (+    36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
1211 15:02:45.866322 (+    58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:45.867129 (+   807us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:45.867133 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:45.867137 (+     4us) client_negotiation.cc:769] Sending connection context
1211 15:02:45.867192 (+    55us) client_negotiation.cc:240] Negotiation successful
1211 15:02:45.867227 (+    35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":107,"threads_started":1}
I20251211 15:02:45.867503 11460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.864485 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:34055 (local address 127.0.0.1:54350)
1211 15:02:45.865514 (+  1029us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:45.865525 (+    11us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:45.865579 (+    54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:45.866163 (+   584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:45.866167 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:45.866191 (+    24us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:45.866547 (+   356us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
1211 15:02:45.866550 (+     3us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:45.866561 (+    11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
1211 15:02:45.866585 (+    24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:45.867326 (+   741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:45.867329 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:45.867332 (+     3us) client_negotiation.cc:769] Sending connection context
1211 15:02:45.867383 (+    51us) client_negotiation.cc:240] Negotiation successful
1211 15:02:45.867412 (+    29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":968,"thread_start_us":75,"threads_started":1}
I20251211 15:02:45.867908 11462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.864860 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54350 (local address 127.5.160.131:34055)
1211 15:02:45.865801 (+   941us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:45.865807 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:45.865828 (+    21us) server_negotiation.cc:408] Connection header received
1211 15:02:45.865878 (+    50us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:45.865883 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:45.866021 (+   138us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:45.866157 (+   136us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:45.867155 (+   998us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:45.867160 (+     5us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:45.867168 (+     8us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:02:45.867179 (+    11us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:45.867221 (+    42us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:02:45.867233 (+    12us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:45.867662 (+   429us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:45.867705 (+    43us) server_negotiation.cc:300] Negotiation successful
1211 15:02:45.867765 (+    60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":843,"thread_start_us":118,"threads_started":1}
I20251211 15:02:45.867905 11458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:45.864097 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51200 (local address 127.5.160.129:34739)
1211 15:02:45.864490 (+   393us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:45.864496 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:45.865347 (+   851us) server_negotiation.cc:408] Connection header received
1211 15:02:45.865436 (+    89us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:45.865441 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:45.865601 (+   160us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:45.865972 (+   371us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:45.866909 (+   937us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:45.866915 (+     6us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:45.866923 (+     8us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:02:45.866962 (+    39us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:45.867003 (+    41us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:02:45.867017 (+    14us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:45.867662 (+   645us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:45.867705 (+    43us) server_negotiation.cc:300] Negotiation successful
1211 15:02:45.867765 (+    60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":120,"threads_started":1}
I20251211 15:02:45.870573 11380 tablet_service.cc:1505] Processing CreateTablet for tablet 572cbc81e6bf49c5a643c1909b5b9214 (DEFAULT_TABLE table=test-table [id=a042ceb2c5fb4e7b95400c49ab25bca3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:45.870659 11118 tablet_service.cc:1505] Processing CreateTablet for tablet 572cbc81e6bf49c5a643c1909b5b9214 (DEFAULT_TABLE table=test-table [id=a042ceb2c5fb4e7b95400c49ab25bca3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:45.870599 11249 tablet_service.cc:1505] Processing CreateTablet for tablet 572cbc81e6bf49c5a643c1909b5b9214 (DEFAULT_TABLE table=test-table [id=a042ceb2c5fb4e7b95400c49ab25bca3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:02:45.871451 11380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572cbc81e6bf49c5a643c1909b5b9214. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:45.871496 11249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572cbc81e6bf49c5a643c1909b5b9214. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:45.871495 11118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572cbc81e6bf49c5a643c1909b5b9214. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:45.876607 11463 tablet_bootstrap.cc:492] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f: Bootstrap starting.
I20251211 15:02:45.878155 11464 tablet_bootstrap.cc:492] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6: Bootstrap starting.
I20251211 15:02:45.878952 11463 tablet_bootstrap.cc:654] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:45.879269 11465 tablet_bootstrap.cc:492] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47: Bootstrap starting.
I20251211 15:02:45.879745 11463 log.cc:826] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:45.880307 11464 tablet_bootstrap.cc:654] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:45.881114 11464 log.cc:826] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:45.881237 11465 tablet_bootstrap.cc:654] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:45.881421 11463 tablet_bootstrap.cc:492] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f: No bootstrap required, opened a new log
I20251211 15:02:45.881609 11463 ts_tablet_manager.cc:1403] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20251211 15:02:45.881906 11465 log.cc:826] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:45.882978 11464 tablet_bootstrap.cc:492] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6: No bootstrap required, opened a new log
I20251211 15:02:45.883149 11464 ts_tablet_manager.cc:1403] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6: Time spent bootstrapping tablet: real 0.005s	user 0.001s	sys 0.003s
I20251211 15:02:45.884263 11463 raft_consensus.cc:359] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6241150b20924ae7953ed2eb4e7e66f6" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34739 } } peers { permanent_uuid: "5e9cf06be59c4645b0eadc29d0ab2b47" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 38511 } } peers { permanent_uuid: "a894acac3d1d43128ea11da23c970f1f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 34055 } }
I20251211 15:02:45.884445 11463 raft_consensus.cc:385] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:45.884487 11463 raft_consensus.cc:740] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a894acac3d1d43128ea11da23c970f1f, State: Initialized, Role: FOLLOWER
I20251211 15:02:45.884863 11463 consensus_queue.cc:260] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6241150b20924ae7953ed2eb4e7e66f6" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34739 } } peers { permanent_uuid: "5e9cf06be59c4645b0eadc29d0ab2b47" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 38511 } } peers { permanent_uuid: "a894acac3d1d43128ea11da23c970f1f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 34055 } }
I20251211 15:02:45.885507 11446 heartbeater.cc:499] Master 127.5.160.190:40565 was elected leader, sending a full tablet report...
I20251211 15:02:45.885461 11464 raft_consensus.cc:359] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6241150b20924ae7953ed2eb4e7e66f6" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34739 } } peers { permanent_uuid: "5e9cf06be59c4645b0eadc29d0ab2b47" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 38511 } } peers { permanent_uuid: "a894acac3d1d43128ea11da23c970f1f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 34055 } }
I20251211 15:02:45.885651 11464 raft_consensus.cc:385] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:45.885651 11463 ts_tablet_manager.cc:1434] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20251211 15:02:45.885704 11464 raft_consensus.cc:740] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6241150b20924ae7953ed2eb4e7e66f6, State: Initialized, Role: FOLLOWER
I20251211 15:02:45.886097 11464 consensus_queue.cc:260] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6241150b20924ae7953ed2eb4e7e66f6" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34739 } } peers { permanent_uuid: "5e9cf06be59c4645b0eadc29d0ab2b47" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 38511 } } peers { permanent_uuid: "a894acac3d1d43128ea11da23c970f1f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 34055 } }
I20251211 15:02:45.886705 11184 heartbeater.cc:499] Master 127.5.160.190:40565 was elected leader, sending a full tablet report...
I20251211 15:02:45.887516 11465 tablet_bootstrap.cc:492] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47: No bootstrap required, opened a new log
I20251211 15:02:45.887693 11465 ts_tablet_manager.cc:1403] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47: Time spent bootstrapping tablet: real 0.009s	user 0.004s	sys 0.000s
I20251211 15:02:45.888026 11464 ts_tablet_manager.cc:1434] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20251211 15:02:45.890802 11465 raft_consensus.cc:359] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6241150b20924ae7953ed2eb4e7e66f6" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34739 } } peers { permanent_uuid: "5e9cf06be59c4645b0eadc29d0ab2b47" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 38511 } } peers { permanent_uuid: "a894acac3d1d43128ea11da23c970f1f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 34055 } }
I20251211 15:02:45.891017 11465 raft_consensus.cc:385] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:45.891083 11465 raft_consensus.cc:740] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9cf06be59c4645b0eadc29d0ab2b47, State: Initialized, Role: FOLLOWER
I20251211 15:02:45.891453 11465 consensus_queue.cc:260] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6241150b20924ae7953ed2eb4e7e66f6" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34739 } } peers { permanent_uuid: "5e9cf06be59c4645b0eadc29d0ab2b47" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 38511 } } peers { permanent_uuid: "a894acac3d1d43128ea11da23c970f1f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 34055 } }
I20251211 15:02:45.892007 11315 heartbeater.cc:499] Master 127.5.160.190:40565 was elected leader, sending a full tablet report...
I20251211 15:02:45.892130 11465 ts_tablet_manager.cc:1434] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
W20251211 15:02:45.923157 11316 tablet.cc:2378] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251211 15:02:46.010458 11185 tablet.cc:2378] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 15:02:46.032912 11471 raft_consensus.cc:493] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:02:46.033099 11471 raft_consensus.cc:515] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6241150b20924ae7953ed2eb4e7e66f6" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34739 } } peers { permanent_uuid: "5e9cf06be59c4645b0eadc29d0ab2b47" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 38511 } } peers { permanent_uuid: "a894acac3d1d43128ea11da23c970f1f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 34055 } }
I20251211 15:02:46.034549 11471 leader_election.cc:290] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6241150b20924ae7953ed2eb4e7e66f6 (127.5.160.129:34739), a894acac3d1d43128ea11da23c970f1f (127.5.160.131:34055)
I20251211 15:02:46.039835 11462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:46.034967 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:53829 (local address 127.5.160.131:34055)
1211 15:02:46.035134 (+   167us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:46.035140 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:46.035221 (+    81us) server_negotiation.cc:408] Connection header received
1211 15:02:46.035369 (+   148us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:46.035373 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:46.035415 (+    42us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:46.035490 (+    75us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:46.039467 (+  3977us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:46.039470 (+     3us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:46.039472 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:02:46.039485 (+    13us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:46.039505 (+    20us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:02:46.039512 (+     7us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:46.039596 (+    84us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:46.039656 (+    60us) server_negotiation.cc:300] Negotiation successful
1211 15:02:46.039698 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20251211 15:02:46.039835 11317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:46.034858 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:34055 (local address 127.5.160.130:53829)
1211 15:02:46.035140 (+   282us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:46.035156 (+    16us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:46.035263 (+   107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:46.035507 (+   244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:46.035510 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:46.035523 (+    13us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:46.039278 (+  3755us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
1211 15:02:46.039280 (+     2us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:46.039293 (+    13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
1211 15:02:46.039321 (+    28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:46.039586 (+   265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:46.039589 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:46.039592 (+     3us) client_negotiation.cc:769] Sending connection context
1211 15:02:46.039661 (+    69us) client_negotiation.cc:240] Negotiation successful
1211 15:02:46.039698 (+    37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178}
I20251211 15:02:46.039835 11458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:46.035038 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:51845 (local address 127.5.160.129:34739)
1211 15:02:46.035157 (+   119us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:46.035161 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:46.035426 (+   265us) server_negotiation.cc:408] Connection header received
1211 15:02:46.035552 (+   126us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:46.035555 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:46.035593 (+    38us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:46.035657 (+    64us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:46.039452 (+  3795us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:46.039455 (+     3us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:46.039458 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:02:46.039472 (+    14us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:46.039494 (+    22us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:02:46.039502 (+     8us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:46.039590 (+    88us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:46.039657 (+    67us) server_negotiation.cc:300] Negotiation successful
1211 15:02:46.039700 (+    43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20251211 15:02:46.039888 11472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:46.034858 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:34739 (local address 127.5.160.130:51845)
1211 15:02:46.035322 (+   464us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:46.035334 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:46.035440 (+   106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:46.035686 (+   246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:46.035689 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:46.035703 (+    14us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:02:46.039264 (+  3561us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
1211 15:02:46.039265 (+     1us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:02:46.039277 (+    12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
1211 15:02:46.039309 (+    32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:02:46.039579 (+   270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:02:46.039582 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:02:46.039585 (+     3us) client_negotiation.cc:769] Sending connection context
1211 15:02:46.039659 (+    74us) client_negotiation.cc:240] Negotiation successful
1211 15:02:46.039704 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"mutex_wait_us":43,"thread_start_us":146,"threads_started":1}
I20251211 15:02:46.040508 11138 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "572cbc81e6bf49c5a643c1909b5b9214" candidate_uuid: "5e9cf06be59c4645b0eadc29d0ab2b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6241150b20924ae7953ed2eb4e7e66f6" is_pre_election: true
I20251211 15:02:46.040531 11400 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "572cbc81e6bf49c5a643c1909b5b9214" candidate_uuid: "5e9cf06be59c4645b0eadc29d0ab2b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a894acac3d1d43128ea11da23c970f1f" is_pre_election: true
I20251211 15:02:46.040776 11400 raft_consensus.cc:2468] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9cf06be59c4645b0eadc29d0ab2b47 in term 0.
I20251211 15:02:46.040774 11138 raft_consensus.cc:2468] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9cf06be59c4645b0eadc29d0ab2b47 in term 0.
I20251211 15:02:46.041313 11204 leader_election.cc:304] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9cf06be59c4645b0eadc29d0ab2b47, 6241150b20924ae7953ed2eb4e7e66f6; no voters: 
I20251211 15:02:46.041574 11471 raft_consensus.cc:2804] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:02:46.041649 11471 raft_consensus.cc:493] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:02:46.041687 11471 raft_consensus.cc:3060] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:46.042649 11471 raft_consensus.cc:515] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6241150b20924ae7953ed2eb4e7e66f6" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34739 } } peers { permanent_uuid: "5e9cf06be59c4645b0eadc29d0ab2b47" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 38511 } } peers { permanent_uuid: "a894acac3d1d43128ea11da23c970f1f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 34055 } }
I20251211 15:02:46.043058 11471 leader_election.cc:290] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [CANDIDATE]: Term 1 election: Requested vote from peers 6241150b20924ae7953ed2eb4e7e66f6 (127.5.160.129:34739), a894acac3d1d43128ea11da23c970f1f (127.5.160.131:34055)
I20251211 15:02:46.043525 11400 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "572cbc81e6bf49c5a643c1909b5b9214" candidate_uuid: "5e9cf06be59c4645b0eadc29d0ab2b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a894acac3d1d43128ea11da23c970f1f"
I20251211 15:02:46.043525 11138 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "572cbc81e6bf49c5a643c1909b5b9214" candidate_uuid: "5e9cf06be59c4645b0eadc29d0ab2b47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6241150b20924ae7953ed2eb4e7e66f6"
I20251211 15:02:46.043663 11400 raft_consensus.cc:3060] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:46.043663 11138 raft_consensus.cc:3060] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:46.044984 11138 raft_consensus.cc:2468] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9cf06be59c4645b0eadc29d0ab2b47 in term 1.
I20251211 15:02:46.045375 11204 leader_election.cc:304] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9cf06be59c4645b0eadc29d0ab2b47, 6241150b20924ae7953ed2eb4e7e66f6; no voters: 
I20251211 15:02:46.045418 11400 raft_consensus.cc:2468] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9cf06be59c4645b0eadc29d0ab2b47 in term 1.
I20251211 15:02:46.045593 11471 raft_consensus.cc:2804] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:46.045811 11471 raft_consensus.cc:697] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9cf06be59c4645b0eadc29d0ab2b47, State: Running, Role: LEADER
I20251211 15:02:46.046173 11471 consensus_queue.cc:237] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6241150b20924ae7953ed2eb4e7e66f6" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34739 } } peers { permanent_uuid: "5e9cf06be59c4645b0eadc29d0ab2b47" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 38511 } } peers { permanent_uuid: "a894acac3d1d43128ea11da23c970f1f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 34055 } }
I20251211 15:02:46.049518 10996 catalog_manager.cc:5654] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9cf06be59c4645b0eadc29d0ab2b47 (127.5.160.130). New cstate: current_term: 1 leader_uuid: "5e9cf06be59c4645b0eadc29d0ab2b47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6241150b20924ae7953ed2eb4e7e66f6" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e9cf06be59c4645b0eadc29d0ab2b47" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 38511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a894acac3d1d43128ea11da23c970f1f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 34055 } health_report { overall_health: UNKNOWN } } }
I20251211 15:02:46.065790 11461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:46.064348 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36356 (local address 127.5.160.130:38511)
1211 15:02:46.064489 (+   141us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:46.064493 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:46.064506 (+    13us) server_negotiation.cc:408] Connection header received
1211 15:02:46.064587 (+    81us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:46.064589 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:46.064646 (+    57us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:46.064719 (+    73us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:46.065453 (+   734us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:46.065457 (+     4us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:46.065459 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:02:46.065471 (+    12us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:46.065500 (+    29us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:02:46.065508 (+     8us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:46.065581 (+    73us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:46.065645 (+    64us) server_negotiation.cc:300] Negotiation successful
1211 15:02:46.065679 (+    34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20251211 15:02:46.071460 11400 raft_consensus.cc:1275] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f [term 1 FOLLOWER]: Refusing update from remote peer 5e9cf06be59c4645b0eadc29d0ab2b47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:46.071460 11138 raft_consensus.cc:1275] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6 [term 1 FOLLOWER]: Refusing update from remote peer 5e9cf06be59c4645b0eadc29d0ab2b47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:02:46.072208 11473 consensus_queue.cc:1048] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a894acac3d1d43128ea11da23c970f1f" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 34055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:46.072431 11471 consensus_queue.cc:1048] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6241150b20924ae7953ed2eb4e7e66f6" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:02:46.080139 11476 mvcc.cc:204] Tried to move back new op lower bound from 7231346139421282304 to 7231346139327987712. Current Snapshot: MvccSnapshot[applied={T|T < 7231346139421282304}]
I20251211 15:02:46.082959 11477 mvcc.cc:204] Tried to move back new op lower bound from 7231346139421282304 to 7231346139327987712. Current Snapshot: MvccSnapshot[applied={T|T < 7231346139421282304}]
I20251211 15:02:46.088915 10994 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:46.089109 10994 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36958:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:02:46.091738 10994 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 4b4fe1c1277643a082f350d7a7c603f6: Sending DeleteTablet for 3 replicas of tablet 572cbc81e6bf49c5a643c1909b5b9214
I20251211 15:02:46.092550 11118 tablet_service.cc:1552] Processing DeleteTablet for tablet 572cbc81e6bf49c5a643c1909b5b9214 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:46 UTC) from {username='slave'} at 127.0.0.1:51200
I20251211 15:02:46.092649 11380 tablet_service.cc:1552] Processing DeleteTablet for tablet 572cbc81e6bf49c5a643c1909b5b9214 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:46 UTC) from {username='slave'} at 127.0.0.1:54350
I20251211 15:02:46.093148 11486 tablet_replica.cc:333] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6: stopping tablet replica
I20251211 15:02:46.093202 11249 tablet_service.cc:1552] Processing DeleteTablet for tablet 572cbc81e6bf49c5a643c1909b5b9214 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:02:46 UTC) from {username='slave'} at 127.0.0.1:36348
I20251211 15:02:46.093508 11486 raft_consensus.cc:2243] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:02:46.093931 11486 raft_consensus.cc:2272] T 572cbc81e6bf49c5a643c1909b5b9214 P 6241150b20924ae7953ed2eb4e7e66f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:46.094257  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 11056
I20251211 15:02:46.094877 11487 tablet_replica.cc:333] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f: stopping tablet replica
I20251211 15:02:46.095186 11487 raft_consensus.cc:2243] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:02:46.095515 11487 raft_consensus.cc:2272] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:46.096843 11487 ts_tablet_manager.cc:1916] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:02:46.099720 11487 ts_tablet_manager.cc:1929] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:02:46.099838 11487 log.cc:1199] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1765465326787564-5762-0/minicluster-data/ts-2/wal/wals/572cbc81e6bf49c5a643c1909b5b9214
I20251211 15:02:46.100297 11487 ts_tablet_manager.cc:1950] T 572cbc81e6bf49c5a643c1909b5b9214 P a894acac3d1d43128ea11da23c970f1f: Deleting consensus metadata
I20251211 15:02:46.101688 10980 catalog_manager.cc:4985] TS a894acac3d1d43128ea11da23c970f1f (127.5.160.131:34055): tablet 572cbc81e6bf49c5a643c1909b5b9214 (table test-table [id=a042ceb2c5fb4e7b95400c49ab25bca3]) successfully deleted
I20251211 15:02:46.103026 11488 tablet_replica.cc:333] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47: stopping tablet replica
I20251211 15:02:46.103343 11488 raft_consensus.cc:2243] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [term 1 LEADER]: Raft consensus shutting down.
W20251211 15:02:46.103541 10982 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.160.129:34739 (error 108)
I20251211 15:02:46.103801 11488 raft_consensus.cc:2272] T 572cbc81e6bf49c5a643c1909b5b9214 P 5e9cf06be59c4645b0eadc29d0ab2b47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:02:46.104342  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 11187
I20251211 15:02:46.104615 11460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:46.104313 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:34739 (local address 127.0.0.1:51216)
1211 15:02:46.104454 (+   141us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:46.104526 (+    72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.129:34739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20251211 15:02:46.105690 10982 catalog_manager.cc:4712] TS 6241150b20924ae7953ed2eb4e7e66f6 (127.5.160.129:34739): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 572cbc81e6bf49c5a643c1909b5b9214: Network error: Client connection negotiation failed: client connection to 127.5.160.129:34739: connect: Connection refused (error 111)
I20251211 15:02:46.109395  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 11318
I20251211 15:02:46.110169 11460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:46.109534 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:38511 (local address 127.0.0.1:36370)
1211 15:02:46.110040 (+   506us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:46.110086 (+    46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.130:38511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405}
I20251211 15:02:46.115335  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 10965
2025-12-11T15:02:46Z chronyd exiting
[       OK ] SecurityITest.TestDisableAuthenticationEncryption (1027 ms)
[ RUN      ] SecurityITest.TestJwtMiniCluster
I20251211 15:02:46.135921  5762 mini_oidc.cc:150] Starting JWKS server
I20251211 15:02:46.137256  5762 webserver.cc:492] Webserver started at https://127.0.0.1:46453/ using document root <none> and password file <none>
I20251211 15:02:46.137388  5762 mini_oidc.cc:186] Starting OIDC Discovery server
I20251211 15:02:46.137581  5762 webserver.cc:492] Webserver started at http://127.0.0.1:38799/ using document root <none> and password file <none>
2025-12-11T15:02:46Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:02:46Z Disabled control of system clock
I20251211 15:02:46.148797  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40775
--webserver_interface=127.5.160.190
--webserver_port=0
--builtin_ntp_servers=127.5.160.148:36651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:40775
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46453/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/testchainca.cert with env {}
W20251211 15:02:46.262780 11495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:02:46.263095 11495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:02:46.263157 11495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:02:46.266777 11495 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:02:46.266863 11495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:02:46.266880 11495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:02:46.266897 11495 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:02:46.266914 11495 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20251211 15:02:46.266960 11495 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20251211 15:02:46.266989 11495 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46453/jwks.json
I20251211 15:02:46.271545 11495 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:36651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:40775
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46453/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:02:46.272635 11495 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:02:46.273468 11495 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:02:46.279137 11500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:46.279142 11501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:02:46.279142 11503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:02:46.279356 11495 server_base.cc:1047] running on GCE node
I20251211 15:02:46.279894 11495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:02:46.280800 11495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:02:46.281958 11495 hybrid_clock.cc:648] HybridClock initialized: now 1765465366281938 us; error 36 us; skew 500 ppm
I20251211 15:02:46.283766 11495 webserver.cc:492] Webserver started at http://127.5.160.190:43533/ using document root <none> and password file <none>
I20251211 15:02:46.284323 11495 fs_manager.cc:362] Metadata directory not provided
I20251211 15:02:46.284379 11495 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:02:46.284554 11495 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:02:46.286161 11495 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "b3254f5c73994d6d89768a60f8efbb13"
format_stamp: "Formatted at 2025-12-11 15:02:46 on dist-test-slave-4k3m"
server_key: "54399f70c16ccefcb3c9bfb27880d6bd"
server_key_iv: "4e515c09433c04809ed2a8fade28cc60"
server_key_version: "encryptionkey@0"
I20251211 15:02:46.286618 11495 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "b3254f5c73994d6d89768a60f8efbb13"
format_stamp: "Formatted at 2025-12-11 15:02:46 on dist-test-slave-4k3m"
server_key: "54399f70c16ccefcb3c9bfb27880d6bd"
server_key_iv: "4e515c09433c04809ed2a8fade28cc60"
server_key_version: "encryptionkey@0"
I20251211 15:02:46.289805 11495 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20251211 15:02:46.291980 11509 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:02:46.293057 11495 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:02:46.293200 11495 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "b3254f5c73994d6d89768a60f8efbb13"
format_stamp: "Formatted at 2025-12-11 15:02:46 on dist-test-slave-4k3m"
server_key: "54399f70c16ccefcb3c9bfb27880d6bd"
server_key_iv: "4e515c09433c04809ed2a8fade28cc60"
server_key_version: "encryptionkey@0"
I20251211 15:02:46.293298 11495 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:02:46.311306 11495 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:02:46.311980 11495 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:02:46.312141 11495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:02:46.319583 11561 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:40775 every 8 connection(s)
I20251211 15:02:46.319593 11495 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:40775
I20251211 15:02:46.320670 11495 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:02:46.323544 11562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:02:46.325320  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 11495
I20251211 15:02:46.325431  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:02:46.325690  5762 external_mini_cluster.cc:1468] Setting key 7e13b55aeb46e4d699e3959852aafc97
I20251211 15:02:46.329653 11562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13: Bootstrap starting.
I20251211 15:02:46.331943 11562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13: Neither blocks nor log segments found. Creating new log.
I20251211 15:02:46.332659 11562 log.cc:826] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13: Log is configured to *not* fsync() on all Append() calls
I20251211 15:02:46.333330 11565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:46.327029 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56154 (local address 127.5.160.190:40775)
1211 15:02:46.327660 (+   631us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:46.327668 (+     8us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:46.327715 (+    47us) server_negotiation.cc:408] Connection header received
1211 15:02:46.328259 (+   544us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:46.328276 (+    17us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:46.328645 (+   369us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:46.328935 (+   290us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:02:46.329449 (+   514us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:46.330232 (+   783us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:46.330888 (+   656us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:46.331195 (+   307us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:46.331731 (+   536us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:02:46.331759 (+    28us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:02:46.331776 (+    17us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:02:46.332192 (+   416us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:02:46.332238 (+    46us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:02:46.332254 (+    16us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:02:46.332352 (+    98us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:46.332514 (+   162us) server_negotiation.cc:300] Negotiation successful
1211 15:02:46.332739 (+   225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":125,"threads_started":1}
I20251211 15:02:46.334436 11562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13: No bootstrap required, opened a new log
I20251211 15:02:46.335901  5762 external_mini_cluster.cc:949] 0 TS(s) registered with all masters
I20251211 15:02:46.337239 11562 raft_consensus.cc:359] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3254f5c73994d6d89768a60f8efbb13" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40775 } }
I20251211 15:02:46.337427 11562 raft_consensus.cc:385] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:02:46.337486 11562 raft_consensus.cc:740] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3254f5c73994d6d89768a60f8efbb13, State: Initialized, Role: FOLLOWER
I20251211 15:02:46.337882 11562 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3254f5c73994d6d89768a60f8efbb13" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40775 } }
I20251211 15:02:46.338008 11562 raft_consensus.cc:399] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:02:46.338053 11562 raft_consensus.cc:493] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:02:46.338116 11562 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:02:46.338920 11562 raft_consensus.cc:515] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3254f5c73994d6d89768a60f8efbb13" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40775 } }
I20251211 15:02:46.339251 11562 leader_election.cc:304] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3254f5c73994d6d89768a60f8efbb13; no voters: 
I20251211 15:02:46.339515 11562 leader_election.cc:290] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:02:46.339612 11567 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:02:46.339797 11567 raft_consensus.cc:697] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [term 1 LEADER]: Becoming Leader. State: Replica: b3254f5c73994d6d89768a60f8efbb13, State: Running, Role: LEADER
I20251211 15:02:46.340070 11567 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3254f5c73994d6d89768a60f8efbb13" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40775 } }
I20251211 15:02:46.340636 11562 sys_catalog.cc:565] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:02:46.341636 11569 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3254f5c73994d6d89768a60f8efbb13. Latest consensus state: current_term: 1 leader_uuid: "b3254f5c73994d6d89768a60f8efbb13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3254f5c73994d6d89768a60f8efbb13" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40775 } } }
I20251211 15:02:46.341760 11569 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:46.342100 11568 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3254f5c73994d6d89768a60f8efbb13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3254f5c73994d6d89768a60f8efbb13" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40775 } } }
I20251211 15:02:46.342185 11576 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:02:46.342437 11568 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13 [sys.catalog]: This master's current role is: LEADER
I20251211 15:02:46.345464 11576 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:02:46.350996 11576 catalog_manager.cc:1357] Generated new cluster ID: cbe5795363464808a5d158acfb7c4277
I20251211 15:02:46.351068 11576 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:02:46.369619 11576 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:02:46.370625 11576 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:02:46.383251 11576 catalog_manager.cc:6027] T 00000000000000000000000000000000 P b3254f5c73994d6d89768a60f8efbb13: Generated new TSK 0
I20251211 15:02:46.384053 11576 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 15:02:46.423960 11565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:46.398839 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56164 (local address 127.5.160.190:40775)
1211 15:02:46.398993 (+   154us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:46.398997 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:46.399092 (+    95us) server_negotiation.cc:408] Connection header received
1211 15:02:46.399287 (+   195us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:46.399290 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:46.399362 (+    72us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:46.399471 (+   109us) server_negotiation.cc:227] Negotiated authn=JWT
1211 15:02:46.399797 (+   326us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:46.400573 (+   776us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:46.401247 (+   674us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:46.401461 (+   214us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:46.401569 (+   108us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
1211 15:02:46.423439 (+ 21870us) server_negotiation.cc:378] Sending JWT_EXCHANGE NegotiatePB response
1211 15:02:46.423562 (+   123us) server_negotiation.cc:1036] Waiting for connection context
1211 15:02:46.423726 (+   164us) server_negotiation.cc:300] Negotiation successful
1211 15:02:46.423794 (+    68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52,"thread_start_us":168,"threads_started":1}
I20251211 15:02:46.434475 11565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:02:46.430434 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56180 (local address 127.5.160.190:40775)
1211 15:02:46.430565 (+   131us) server_negotiation.cc:207] Beginning negotiation
1211 15:02:46.430570 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:02:46.430635 (+    65us) server_negotiation.cc:408] Connection header received
1211 15:02:46.430746 (+   111us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:02:46.430750 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:02:46.430799 (+    49us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:02:46.430887 (+    88us) server_negotiation.cc:227] Negotiated authn=JWT
1211 15:02:46.431222 (+   335us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:46.432010 (+   788us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:02:46.432729 (+   719us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:02:46.432928 (+   199us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:46.432979 (+    51us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
1211 15:02:46.434111 (+  1132us) server_negotiation.cc:395] Sending RPC error: FATAL_INVALID_JWT: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
1211 15:02:46.434338 (+   227us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56180: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
Metrics: {"server-negotiator.queue_time_us":55}
W20251211 15:02:46.434556 11565 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56180: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
W20251211 15:02:46.435271 11598 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:02:46.430320 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40775 (local address 127.0.0.1:56180)
1211 15:02:46.430561 (+   241us) negotiation.cc:107] Waiting for socket to connect
1211 15:02:46.430573 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:02:46.430664 (+    91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:02:46.430891 (+   227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:02:46.430893 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:02:46.430899 (+     6us) client_negotiation.cc:189] Negotiated authn=JWT
1211 15:02:46.431119 (+   220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:46.431127 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:46.432179 (+  1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:02:46.432183 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:02:46.432616 (+   433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:02:46.432625 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:02:46.432734 (+   109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:02:46.432764 (+    30us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
1211 15:02:46.434309 (+  1545us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
1211 15:02:46.434469 (+   160us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.160.190:40775: FATAL_INVALID_JWT: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":97,"threads_started":1}
I20251211 15:03:01.444036 11604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:01.439999 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59588 (local address 127.5.160.190:40775)
1211 15:03:01.440293 (+   294us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:01.440297 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:01.440317 (+    20us) server_negotiation.cc:408] Connection header received
1211 15:03:01.440388 (+    71us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:01.440391 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:01.440449 (+    58us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:01.440570 (+   121us) server_negotiation.cc:227] Negotiated authn=JWT
1211 15:03:01.441095 (+   525us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:01.441704 (+   609us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:01.442583 (+   879us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:01.442831 (+   248us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:01.442889 (+    58us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
1211 15:03:01.443656 (+   767us) server_negotiation.cc:395] Sending RPC error: FATAL_INVALID_JWT: Not authorized: JWT verification failed: token expired
1211 15:03:01.443864 (+   208us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59588: JWT verification failed: token expired
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":108,"threads_started":1}
W20251211 15:03:01.444114 11603 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:01.439730 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40775 (local address 127.0.0.1:59588)
1211 15:03:01.440084 (+   354us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:01.440098 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:01.440196 (+    98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:01.440659 (+   463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:01.440662 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:01.440671 (+     9us) client_negotiation.cc:189] Negotiated authn=JWT
1211 15:03:01.440905 (+   234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:01.440913 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:01.441968 (+  1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:01.441973 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:01.442454 (+   481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:01.442466 (+    12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:01.442590 (+   124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:01.442628 (+    38us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
1211 15:03:01.443793 (+  1165us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: JWT verification failed: token expired
1211 15:03:01.443967 (+   174us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.160.190:40775: FATAL_INVALID_JWT: Not authorized: JWT verification failed: token expired
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":139,"threads_started":1}
W20251211 15:03:01.444151 11604 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59588: JWT verification failed: token expired
W20251211 15:03:01.447247 11604 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:01.446266 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59590 (local address 127.5.160.190:40775)
1211 15:03:01.446421 (+   155us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:01.446425 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:01.446480 (+    55us) server_negotiation.cc:408] Connection header received
1211 15:03:01.446594 (+   114us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:01.446596 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:01.446648 (+    52us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:01.446721 (+    73us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:01.447120 (+   399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59590: BlockingRecv error: recv got EOF from 127.0.0.1:59590 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20251211 15:03:01.450789 11614 client_negotiation.cc:375] the client has a JWT but it isn't advertising its JWT-based authn capability since it doesn't trust the certificate of the server at 127.5.160.190:40775
W20251211 15:03:01.451514 11604 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:01.450497 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59592 (local address 127.5.160.190:40775)
1211 15:03:01.450648 (+   151us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:01.450651 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:01.450735 (+    84us) server_negotiation.cc:408] Connection header received
1211 15:03:01.451033 (+   298us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:01.451037 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:01.451105 (+    68us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:01.451183 (+    78us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:01.451379 (+   196us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59592: BlockingRecv error: recv got EOF from 127.0.0.1:59592 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20251211 15:03:01.451892  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 11495
2025-12-11T15:03:01Z chronyd exiting
[       OK ] SecurityITest.TestJwtMiniCluster (15356 ms)
[ RUN      ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20251211 15:03:01.492535  5762 mini_oidc.cc:150] Starting JWKS server
I20251211 15:03:01.493556  5762 webserver.cc:492] Webserver started at https://127.0.0.1:33601/ using document root <none> and password file <none>
I20251211 15:03:01.493643  5762 mini_oidc.cc:186] Starting OIDC Discovery server
I20251211 15:03:01.493849  5762 webserver.cc:492] Webserver started at http://127.0.0.1:45107/ using document root <none> and password file <none>
2025-12-11T15:03:01Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:03:01Z Disabled control of system clock
I20251211 15:03:01.502805  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:34899
--webserver_interface=127.5.160.190
--webserver_port=0
--builtin_ntp_servers=127.5.160.148:40085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:34899
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33601/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/testchainca.cert with env {}
W20251211 15:03:01.627918 11620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:01.628223 11620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:01.628299 11620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:01.631793 11620 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:03:01.631863 11620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:01.631887 11620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:01.631911 11620 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:03:01.631942 11620 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20251211 15:03:01.631974 11620 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20251211 15:03:01.631999 11620 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33601/jwks.json
I20251211 15:03:01.636513 11620 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:40085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:34899
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:34899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33601/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:01.637764 11620 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:01.638756 11620 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:01.645747 11625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:01.645844 11620 server_base.cc:1047] running on GCE node
W20251211 15:03:01.645769 11626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:01.645769 11628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:01.646536 11620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:01.647661 11620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:01.648837 11620 hybrid_clock.cc:648] HybridClock initialized: now 1765465381648793 us; error 40 us; skew 500 ppm
I20251211 15:03:01.650826 11620 webserver.cc:492] Webserver started at http://127.5.160.190:34781/ using document root <none> and password file <none>
I20251211 15:03:01.651489 11620 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:01.651549 11620 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:01.651747 11620 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:01.653692 11620 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "39593017f05541f49cb054f99d4be158"
format_stamp: "Formatted at 2025-12-11 15:03:01 on dist-test-slave-4k3m"
server_key: "0cdb50ef85d10f543dca69ff4ae1a4d5"
server_key_iv: "c2bfc3c1197b773b2024f778993ab843"
server_key_version: "encryptionkey@0"
I20251211 15:03:01.654212 11620 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "39593017f05541f49cb054f99d4be158"
format_stamp: "Formatted at 2025-12-11 15:03:01 on dist-test-slave-4k3m"
server_key: "0cdb50ef85d10f543dca69ff4ae1a4d5"
server_key_iv: "c2bfc3c1197b773b2024f778993ab843"
server_key_version: "encryptionkey@0"
I20251211 15:03:01.658298 11620 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20251211 15:03:01.661181 11634 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:01.662461 11620 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20251211 15:03:01.662585 11620 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "39593017f05541f49cb054f99d4be158"
format_stamp: "Formatted at 2025-12-11 15:03:01 on dist-test-slave-4k3m"
server_key: "0cdb50ef85d10f543dca69ff4ae1a4d5"
server_key_iv: "c2bfc3c1197b773b2024f778993ab843"
server_key_version: "encryptionkey@0"
I20251211 15:03:01.662681 11620 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:01.683151 11620 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:01.683983 11620 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:01.684167 11620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:01.692981 11620 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:34899
I20251211 15:03:01.693054 11686 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:34899 every 8 connection(s)
I20251211 15:03:01.694216 11620 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:03:01.697857 11687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:01.699641  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 11620
I20251211 15:03:01.699767  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:03:01.700117  5762 external_mini_cluster.cc:1468] Setting key 26f17ac5affb257e17e043d560cb8eff
I20251211 15:03:01.705392 11687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158: Bootstrap starting.
I20251211 15:03:01.708280 11687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:01.709089 11687 log.cc:826] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:01.711676 11687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158: No bootstrap required, opened a new log
I20251211 15:03:01.713115 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:01.701892 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46142 (local address 127.5.160.190:34899)
1211 15:03:01.702675 (+   783us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:01.702685 (+    10us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:01.702729 (+    44us) server_negotiation.cc:408] Connection header received
1211 15:03:01.703474 (+   745us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:01.703496 (+    22us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:01.703935 (+   439us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:01.704300 (+   365us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:01.704972 (+   672us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:01.706010 (+  1038us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:01.707080 (+  1070us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:01.707325 (+   245us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:01.711106 (+  3781us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:01.711135 (+    29us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:01.711150 (+    15us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:03:01.711616 (+   466us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:01.711672 (+    56us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:03:01.711690 (+    18us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:01.711814 (+   124us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:01.712009 (+   195us) server_negotiation.cc:300] Negotiation successful
1211 15:03:01.712343 (+   334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":170,"threads_started":1}
I20251211 15:03:01.714620 11687 raft_consensus.cc:359] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39593017f05541f49cb054f99d4be158" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 34899 } }
I20251211 15:03:01.714882 11687 raft_consensus.cc:385] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:01.714958 11687 raft_consensus.cc:740] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39593017f05541f49cb054f99d4be158, State: Initialized, Role: FOLLOWER
I20251211 15:03:01.715463 11687 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39593017f05541f49cb054f99d4be158" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 34899 } }
I20251211 15:03:01.715636 11687 raft_consensus.cc:399] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:03:01.715708 11687 raft_consensus.cc:493] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:03:01.715806 11687 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:01.716799  5762 external_mini_cluster.cc:949] 0 TS(s) registered with all masters
I20251211 15:03:01.716892 11687 raft_consensus.cc:515] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39593017f05541f49cb054f99d4be158" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 34899 } }
I20251211 15:03:01.717283 11687 leader_election.cc:304] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39593017f05541f49cb054f99d4be158; no voters: 
I20251211 15:03:01.717628 11687 leader_election.cc:290] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:03:01.717763 11692 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:01.718062 11692 raft_consensus.cc:697] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [term 1 LEADER]: Becoming Leader. State: Replica: 39593017f05541f49cb054f99d4be158, State: Running, Role: LEADER
I20251211 15:03:01.718462 11692 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39593017f05541f49cb054f99d4be158" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 34899 } }
I20251211 15:03:01.718962 11687 sys_catalog.cc:565] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:03:01.720460 11693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39593017f05541f49cb054f99d4be158" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39593017f05541f49cb054f99d4be158" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 34899 } } }
I20251211 15:03:01.720597 11693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:01.720677 11694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39593017f05541f49cb054f99d4be158. Latest consensus state: current_term: 1 leader_uuid: "39593017f05541f49cb054f99d4be158" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39593017f05541f49cb054f99d4be158" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 34899 } } }
I20251211 15:03:01.720801 11694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:01.721071 11702 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:03:01.724440 11702 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:03:01.730057 11702 catalog_manager.cc:1357] Generated new cluster ID: 493306eeb9e144ac97804a45ac369d55
I20251211 15:03:01.730151 11702 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:03:01.751163 11702 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:03:01.752301 11702 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:03:01.760334 11702 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 39593017f05541f49cb054f99d4be158: Generated new TSK 0
I20251211 15:03:01.761304 11702 catalog_manager.cc:1524] Initializing in-progress tserver states...
E20251211 15:03:01.797708 11717 webserver.cc:578] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20251211 15:03:01.797895 11717 webserver.cc:578] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20251211 15:03:01.798557 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:01.781671 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46154 (local address 127.5.160.190:34899)
1211 15:03:01.781840 (+   169us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:01.781845 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:01.781972 (+   127us) server_negotiation.cc:408] Connection header received
1211 15:03:01.782167 (+   195us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:01.782171 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:01.782249 (+    78us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:01.782392 (+   143us) server_negotiation.cc:227] Negotiated authn=JWT
1211 15:03:01.782749 (+   357us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:01.783664 (+   915us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:01.784452 (+   788us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:01.784660 (+   208us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:01.784787 (+   127us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
1211 15:03:01.798082 (+ 13295us) server_negotiation.cc:395] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33601/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
1211 15:03:01.798393 (+   311us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46154: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33601/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":76}
W20251211 15:03:01.798656 11690 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46154: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33601/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20251211 15:03:01.798684 11716 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:01.781524 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:34899 (local address 127.0.0.1:46154)
1211 15:03:01.781873 (+   349us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:01.781888 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:01.782004 (+   116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:01.782386 (+   382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:01.782388 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:01.782395 (+     7us) client_negotiation.cc:189] Negotiated authn=JWT
1211 15:03:01.782647 (+   252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:01.782654 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:01.783806 (+  1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:01.783810 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:01.784345 (+   535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:01.784353 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:01.784461 (+   108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:01.784487 (+    26us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
1211 15:03:01.798323 (+ 13836us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33601/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
1211 15:03:01.798485 (+   162us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.160.190:34899: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33601/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":142,"threads_started":1}
I20251211 15:03:01.799714  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 11620
2025-12-11T15:03:01Z chronyd exiting
[       OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (348 ms)
[ RUN      ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20251211 15:03:01.840857  5762 mini_oidc.cc:150] Starting JWKS server
I20251211 15:03:01.841850  5762 webserver.cc:492] Webserver started at https://127.0.0.1:45493/ using document root <none> and password file <none>
I20251211 15:03:01.841938  5762 mini_oidc.cc:186] Starting OIDC Discovery server
I20251211 15:03:01.842135  5762 webserver.cc:492] Webserver started at http://127.0.0.1:38411/ using document root <none> and password file <none>
2025-12-11T15:03:01Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:03:01Z Disabled control of system clock
I20251211 15:03:01.849561  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:45741
--webserver_interface=127.5.160.190
--webserver_port=0
--builtin_ntp_servers=127.5.160.148:43073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:45741
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45493/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20251211 15:03:01.964459 11723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:01.964689 11723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:01.964740 11723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:01.968222 11723 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:03:01.968294 11723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:01.968310 11723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:01.968328 11723 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:03:01.968351 11723 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20251211 15:03:01.968384 11723 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20251211 15:03:01.968408 11723 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45493/jwks.json
I20251211 15:03:01.972425 11723 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:43073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:45741
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:45741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45493/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:01.973583 11723 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:01.974792 11723 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:01.980779 11728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:01.980785 11729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:01.980912 11723 server_base.cc:1047] running on GCE node
W20251211 15:03:01.980785 11731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:01.981676 11723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:01.982666 11723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:01.983821 11723 hybrid_clock.cc:648] HybridClock initialized: now 1765465381983806 us; error 33 us; skew 500 ppm
I20251211 15:03:01.985656 11723 webserver.cc:492] Webserver started at http://127.5.160.190:35267/ using document root <none> and password file <none>
I20251211 15:03:01.986225 11723 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:01.986289 11723 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:01.986495 11723 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:01.988242 11723 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "19a8e68f08494b33b12b08c6bd191825"
format_stamp: "Formatted at 2025-12-11 15:03:01 on dist-test-slave-4k3m"
server_key: "2213146c62151a1081eaab256766e170"
server_key_iv: "5834dfa2c77b6f4cc1bf54d98b10d75e"
server_key_version: "encryptionkey@0"
I20251211 15:03:01.988715 11723 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "19a8e68f08494b33b12b08c6bd191825"
format_stamp: "Formatted at 2025-12-11 15:03:01 on dist-test-slave-4k3m"
server_key: "2213146c62151a1081eaab256766e170"
server_key_iv: "5834dfa2c77b6f4cc1bf54d98b10d75e"
server_key_version: "encryptionkey@0"
I20251211 15:03:01.992228 11723 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20251211 15:03:01.994701 11737 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:01.995842 11723 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:01.995954 11723 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "19a8e68f08494b33b12b08c6bd191825"
format_stamp: "Formatted at 2025-12-11 15:03:01 on dist-test-slave-4k3m"
server_key: "2213146c62151a1081eaab256766e170"
server_key_iv: "5834dfa2c77b6f4cc1bf54d98b10d75e"
server_key_version: "encryptionkey@0"
I20251211 15:03:01.996044 11723 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:02.016353 11723 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:02.017015 11723 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:02.017179 11723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:02.024188 11789 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:45741 every 8 connection(s)
I20251211 15:03:02.024189 11723 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:45741
I20251211 15:03:02.025274 11723 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:03:02.028523 11790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:02.034276 11790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825: Bootstrap starting.
I20251211 15:03:02.034871  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 11723
I20251211 15:03:02.035003  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:03:02.035250  5762 external_mini_cluster.cc:1468] Setting key 08393e46483f303aabc0810f4d4ccb5a
I20251211 15:03:02.036875 11790 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:02.037535 11790 log.cc:826] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:02.039573 11790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825: No bootstrap required, opened a new log
I20251211 15:03:02.042472 11790 raft_consensus.cc:359] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19a8e68f08494b33b12b08c6bd191825" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 45741 } }
I20251211 15:03:02.042686 11790 raft_consensus.cc:385] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:02.042753 11790 raft_consensus.cc:740] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a8e68f08494b33b12b08c6bd191825, State: Initialized, Role: FOLLOWER
I20251211 15:03:02.043200 11790 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19a8e68f08494b33b12b08c6bd191825" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 45741 } }
I20251211 15:03:02.043315 11793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:02.036450 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49862 (local address 127.5.160.190:45741)
1211 15:03:02.037083 (+   633us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:02.037092 (+     9us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:02.037127 (+    35us) server_negotiation.cc:408] Connection header received
1211 15:03:02.037697 (+   570us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:02.037716 (+    19us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:02.038157 (+   441us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:02.038473 (+   316us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:02.039094 (+   621us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:02.039875 (+   781us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:02.040755 (+   880us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:02.041009 (+   254us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:02.041559 (+   550us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:02.041592 (+    33us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:02.041606 (+    14us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:03:02.042029 (+   423us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:02.042079 (+    50us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:03:02.042099 (+    20us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:02.042200 (+   101us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:02.042369 (+   169us) server_negotiation.cc:300] Negotiation successful
1211 15:03:02.042575 (+   206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":121,"threads_started":1}
I20251211 15:03:02.043320 11790 raft_consensus.cc:399] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:03:02.043428 11790 raft_consensus.cc:493] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:03:02.043515 11790 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:02.044306 11790 raft_consensus.cc:515] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19a8e68f08494b33b12b08c6bd191825" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 45741 } }
I20251211 15:03:02.044627 11790 leader_election.cc:304] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19a8e68f08494b33b12b08c6bd191825; no voters: 
I20251211 15:03:02.044916 11790 leader_election.cc:290] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:03:02.044993 11795 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:02.045192 11795 raft_consensus.cc:697] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [term 1 LEADER]: Becoming Leader. State: Replica: 19a8e68f08494b33b12b08c6bd191825, State: Running, Role: LEADER
I20251211 15:03:02.045485 11795 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19a8e68f08494b33b12b08c6bd191825" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 45741 } }
I20251211 15:03:02.045882  5762 external_mini_cluster.cc:949] 0 TS(s) registered with all masters
I20251211 15:03:02.046109 11790 sys_catalog.cc:565] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:03:02.047044 11796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19a8e68f08494b33b12b08c6bd191825" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19a8e68f08494b33b12b08c6bd191825" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 45741 } } }
I20251211 15:03:02.047072 11797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19a8e68f08494b33b12b08c6bd191825. Latest consensus state: current_term: 1 leader_uuid: "19a8e68f08494b33b12b08c6bd191825" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19a8e68f08494b33b12b08c6bd191825" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 45741 } } }
I20251211 15:03:02.047166 11796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:02.047169 11797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:02.047544 11804 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:03:02.050602 11804 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:03:02.056458 11804 catalog_manager.cc:1357] Generated new cluster ID: 9e970ccf27cb40adaa40b42fad7c8870
I20251211 15:03:02.056550 11804 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:03:02.074621 11804 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:03:02.075894 11804 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:03:02.090723 11804 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 19a8e68f08494b33b12b08c6bd191825: Generated new TSK 0
I20251211 15:03:02.091655 11804 catalog_manager.cc:1524] Initializing in-progress tserver states...
E20251211 15:03:02.126726 11820 webserver.cc:578] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20251211 15:03:02.126814 11820 webserver.cc:578] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20251211 15:03:02.128368 11793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:02.106576 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49878 (local address 127.5.160.190:45741)
1211 15:03:02.106715 (+   139us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:02.106720 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:02.106784 (+    64us) server_negotiation.cc:408] Connection header received
1211 15:03:02.107038 (+   254us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:02.107042 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:02.107110 (+    68us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:02.107271 (+   161us) server_negotiation.cc:227] Negotiated authn=JWT
1211 15:03:02.107655 (+   384us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:02.108235 (+   580us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:02.108919 (+   684us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:02.109110 (+   191us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:02.109222 (+   112us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
1211 15:03:02.127747 (+ 18525us) server_negotiation.cc:395] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45493/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
1211 15:03:02.128223 (+   476us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49878: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45493/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":59}
W20251211 15:03:02.128432 11793 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49878: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45493/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20251211 15:03:02.128868 11819 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:02.106441 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:45741 (local address 127.0.0.1:49878)
1211 15:03:02.106700 (+   259us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:02.106713 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:02.106810 (+    97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:02.107276 (+   466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:02.107280 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:02.107289 (+     9us) client_negotiation.cc:189] Negotiated authn=JWT
1211 15:03:02.107549 (+   260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:02.107559 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:02.108360 (+   801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:02.108364 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:02.108803 (+   439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:02.108812 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:02.108936 (+   124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:02.108966 (+    30us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
1211 15:03:02.127958 (+ 18992us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45493/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
1211 15:03:02.128671 (+   713us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.160.190:45741: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45493/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":97,"threads_started":1}
I20251211 15:03:02.130385  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 11723
2025-12-11T15:03:02Z chronyd exiting
[       OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (330 ms)
[ RUN      ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2025-12-11T15:03:02Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:03:02Z Disabled control of system clock
I20251211 15:03:02.178359  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:36713
--webserver_interface=127.5.160.190
--webserver_port=0
--builtin_ntp_servers=127.5.160.148:44479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:36713
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/testchainca.cert with env {}
W20251211 15:03:02.286002 11824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:02.286242 11824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:02.286293 11824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:02.289683 11824 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:03:02.289759 11824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:02.289795 11824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:02.289814 11824 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:03:02.289834 11824 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20251211 15:03:02.289865 11824 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20251211 15:03:02.289883 11824 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20251211 15:03:02.294536 11824 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:44479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:36713
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:36713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:02.295940 11824 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:02.297021 11824 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:02.304119 11829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:02.304114 11832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:02.304114 11830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:02.304533 11824 server_base.cc:1047] running on GCE node
I20251211 15:03:02.305183 11824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:02.306507 11824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:02.307718 11824 hybrid_clock.cc:648] HybridClock initialized: now 1765465382307696 us; error 44 us; skew 500 ppm
I20251211 15:03:02.309675 11824 webserver.cc:492] Webserver started at http://127.5.160.190:38979/ using document root <none> and password file <none>
I20251211 15:03:02.310254 11824 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:02.310321 11824 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:02.310498 11824 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:02.312230 11824 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "2a5902e64fe74a8c9caf07ae1a18da03"
format_stamp: "Formatted at 2025-12-11 15:03:02 on dist-test-slave-4k3m"
server_key: "6860fe9dc2b794784e28ed279939b845"
server_key_iv: "e361c7fb50e5ca5dcfede0218e70a965"
server_key_version: "encryptionkey@0"
I20251211 15:03:02.312716 11824 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "2a5902e64fe74a8c9caf07ae1a18da03"
format_stamp: "Formatted at 2025-12-11 15:03:02 on dist-test-slave-4k3m"
server_key: "6860fe9dc2b794784e28ed279939b845"
server_key_iv: "e361c7fb50e5ca5dcfede0218e70a965"
server_key_version: "encryptionkey@0"
I20251211 15:03:02.316205 11824 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20251211 15:03:02.318607 11838 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:02.319775 11824 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:02.319887 11824 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "2a5902e64fe74a8c9caf07ae1a18da03"
format_stamp: "Formatted at 2025-12-11 15:03:02 on dist-test-slave-4k3m"
server_key: "6860fe9dc2b794784e28ed279939b845"
server_key_iv: "e361c7fb50e5ca5dcfede0218e70a965"
server_key_version: "encryptionkey@0"
I20251211 15:03:02.319980 11824 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:02.345840 11824 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:02.346531 11824 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:02.346699 11824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:02.353735 11824 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:36713
I20251211 15:03:02.353790 11890 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:36713 every 8 connection(s)
I20251211 15:03:02.354792 11824 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:03:02.357758 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:02.363461 11891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03: Bootstrap starting.
I20251211 15:03:02.364101  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 11824
I20251211 15:03:02.364219  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:03:02.364449  5762 external_mini_cluster.cc:1468] Setting key 424ad4b7e89dbe526402c70db313926f
I20251211 15:03:02.366142 11891 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:02.366832 11891 log.cc:826] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:02.368566 11891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03: No bootstrap required, opened a new log
I20251211 15:03:02.371227 11891 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a5902e64fe74a8c9caf07ae1a18da03" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 36713 } }
I20251211 15:03:02.371416 11891 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:02.371456 11891 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a5902e64fe74a8c9caf07ae1a18da03, State: Initialized, Role: FOLLOWER
I20251211 15:03:02.371906 11894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:02.365629 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53824 (local address 127.5.160.190:36713)
1211 15:03:02.366300 (+   671us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:02.366309 (+     9us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:02.366344 (+    35us) server_negotiation.cc:408] Connection header received
1211 15:03:02.366900 (+   556us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:02.366950 (+    50us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:02.367317 (+   367us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:02.367612 (+   295us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:02.368079 (+   467us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:02.368839 (+   760us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:02.369486 (+   647us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:02.369753 (+   267us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:02.370250 (+   497us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:02.370281 (+    31us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:02.370291 (+    10us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:03:02.370665 (+   374us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:02.370705 (+    40us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:03:02.370719 (+    14us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:02.370813 (+    94us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:02.370997 (+   184us) server_negotiation.cc:300] Negotiation successful
1211 15:03:02.371241 (+   244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":146,"threads_started":1}
I20251211 15:03:02.371908 11891 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a5902e64fe74a8c9caf07ae1a18da03" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 36713 } }
I20251211 15:03:02.372089 11891 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:03:02.372152 11891 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:03:02.372267 11891 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:02.373142 11891 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a5902e64fe74a8c9caf07ae1a18da03" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 36713 } }
I20251211 15:03:02.373509 11891 leader_election.cc:304] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a5902e64fe74a8c9caf07ae1a18da03; no voters: 
I20251211 15:03:02.373798 11891 leader_election.cc:290] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:03:02.373893 11896 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:02.374092 11896 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [term 1 LEADER]: Becoming Leader. State: Replica: 2a5902e64fe74a8c9caf07ae1a18da03, State: Running, Role: LEADER
I20251211 15:03:02.374377 11896 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a5902e64fe74a8c9caf07ae1a18da03" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 36713 } }
I20251211 15:03:02.374712  5762 external_mini_cluster.cc:949] 0 TS(s) registered with all masters
I20251211 15:03:02.375005 11891 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:03:02.375999 11897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a5902e64fe74a8c9caf07ae1a18da03. Latest consensus state: current_term: 1 leader_uuid: "2a5902e64fe74a8c9caf07ae1a18da03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a5902e64fe74a8c9caf07ae1a18da03" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 36713 } } }
I20251211 15:03:02.376117 11897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:02.376816 11898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a5902e64fe74a8c9caf07ae1a18da03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a5902e64fe74a8c9caf07ae1a18da03" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 36713 } } }
I20251211 15:03:02.376922 11898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:02.377221 11905 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:03:02.379845 11905 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:03:02.384696 11905 catalog_manager.cc:1357] Generated new cluster ID: e2d41d20a7d340ac9a4628c553342dc3
I20251211 15:03:02.384768 11905 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:03:02.400959 11905 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:03:02.401904 11905 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:03:02.415501 11905 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 2a5902e64fe74a8c9caf07ae1a18da03: Generated new TSK 0
I20251211 15:03:02.416599 11905 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 15:03:02.497673 11894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:02.434853 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53826 (local address 127.5.160.190:36713)
1211 15:03:02.435027 (+   174us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:02.435031 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:02.435107 (+    76us) server_negotiation.cc:408] Connection header received
1211 15:03:02.435395 (+   288us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:02.435400 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:02.435468 (+    68us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:02.435571 (+   103us) server_negotiation.cc:227] Negotiated authn=JWT
1211 15:03:02.435901 (+   330us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:02.436720 (+   819us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:02.437422 (+   702us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:02.437624 (+   202us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:02.437741 (+   117us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
1211 15:03:02.497169 (+ 59428us) server_negotiation.cc:395] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Could not resolve hostname: Could not resolve host: default.url
1211 15:03:02.497518 (+   349us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53826: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Could not resolve hostname: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":62}
W20251211 15:03:02.497761 11894 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53826: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Could not resolve hostname: Could not resolve host: default.url
W20251211 15:03:02.497754 11920 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:02.434723 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:36713 (local address 127.0.0.1:53826)
1211 15:03:02.435012 (+   289us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:02.435029 (+    17us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:02.435236 (+   207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:02.435591 (+   355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:02.435593 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:02.435601 (+     8us) client_negotiation.cc:189] Negotiated authn=JWT
1211 15:03:02.435809 (+   208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:02.435816 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:02.436854 (+  1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:02.436857 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:02.437323 (+   466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:02.437332 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:02.437435 (+   103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:02.437461 (+    26us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
1211 15:03:02.497448 (+ 59987us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Could not resolve hostname: Could not resolve host: default.url
1211 15:03:02.497599 (+   151us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.160.190:36713: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Could not resolve hostname: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":98,"threads_started":1}
I20251211 15:03:02.498483  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 11824
2025-12-11T15:03:02Z chronyd exiting
[       OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (345 ms)
[ RUN      ] SecurityITest.TestWorldReadableKeytab
[       OK ] SecurityITest.TestWorldReadableKeytab (118 ms)
[ RUN      ] SecurityITest.TestWorldReadablePrivateKey
[       OK ] SecurityITest.TestWorldReadablePrivateKey (120 ms)
[ RUN      ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:03:02 dist-test-slave-4k3m krb5kdc[11932](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:03:02 dist-test-slave-4k3m krb5kdc[11932](info): set up 2 sockets
Dec 11 15:03:02 dist-test-slave-4k3m krb5kdc[11932](info): commencing operation
krb5kdc: starting...
W20251211 15:03:04.575515  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.819s	user 0.006s	sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:03:04 dist-test-slave-4k3m krb5kdc[11932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:03:04Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:03:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:03:04.714497  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:33175
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:40943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:33175
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:04.823133 11948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:04.823401 11948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:04.823482 11948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:04.826905 11948 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:03:04.827046 11948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:04.827073 11948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:04.827092 11948 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:03:04.827108 11948 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:03:04.831744 11948 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:40943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:33175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:33175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:04.832870 11948 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:04.833701 11948 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:04.840098 11956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:04.840188 11953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:04.840098 11954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:04.840389 11948 server_base.cc:1047] running on GCE node
I20251211 15:03:04.840914 11948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:04.841871 11948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:04.843078 11948 hybrid_clock.cc:648] HybridClock initialized: now 1765465384843067 us; error 32 us; skew 500 ppm
Dec 11 15:03:04 dist-test-slave-4k3m krb5kdc[11932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465384, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:04.845758 11948 init.cc:377] Logged in from keytab as kudu/127.5.160.190@KRBTEST.COM (short username kudu)
I20251211 15:03:04.846837 11948 webserver.cc:492] Webserver started at http://127.5.160.190:43065/ using document root <none> and password file <none>
I20251211 15:03:04.847422 11948 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:04.847473 11948 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:04.847656 11948 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:04.850036 11948 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "74d1a4ce4592454babe306de6de04429"
format_stamp: "Formatted at 2025-12-11 15:03:04 on dist-test-slave-4k3m"
server_key: "66cdf2988c2f5b0c6e46969c819f026a"
server_key_iv: "22116cb0aa95cf8445e86599db27832a"
server_key_version: "encryptionkey@0"
I20251211 15:03:04.850651 11948 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "74d1a4ce4592454babe306de6de04429"
format_stamp: "Formatted at 2025-12-11 15:03:04 on dist-test-slave-4k3m"
server_key: "66cdf2988c2f5b0c6e46969c819f026a"
server_key_iv: "22116cb0aa95cf8445e86599db27832a"
server_key_version: "encryptionkey@0"
I20251211 15:03:04.854410 11948 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20251211 15:03:04.856964 11963 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:04.857970 11948 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:04.858083 11948 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "74d1a4ce4592454babe306de6de04429"
format_stamp: "Formatted at 2025-12-11 15:03:04 on dist-test-slave-4k3m"
server_key: "66cdf2988c2f5b0c6e46969c819f026a"
server_key_iv: "22116cb0aa95cf8445e86599db27832a"
server_key_version: "encryptionkey@0"
I20251211 15:03:04.858175 11948 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:04.880504 11948 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:04.883487 11948 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:04.883679 11948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:04.890784 12015 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:33175 every 8 connection(s)
I20251211 15:03:04.890780 11948 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:33175
I20251211 15:03:04.891891 11948 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:03:04.894636 12016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:04.900347 12016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429: Bootstrap starting.
I20251211 15:03:04.900756  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 11948
I20251211 15:03:04.900879  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:03:04.901093  5762 external_mini_cluster.cc:1468] Setting key 4ce7d8b2a6057126446cbcb6abb52840
I20251211 15:03:04.902874 12016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:04.903784 12016 log.cc:826] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:04.905920 12016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429: No bootstrap required, opened a new log
Dec 11 15:03:04 dist-test-slave-4k3m krb5kdc[11932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:03:04.908833 12016 raft_consensus.cc:359] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74d1a4ce4592454babe306de6de04429" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 33175 } }
I20251211 15:03:04.909087 12016 raft_consensus.cc:385] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:04.909142 12016 raft_consensus.cc:740] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d1a4ce4592454babe306de6de04429, State: Initialized, Role: FOLLOWER
I20251211 15:03:04.909584 12016 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74d1a4ce4592454babe306de6de04429" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 33175 } }
I20251211 15:03:04.909759 12016 raft_consensus.cc:399] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:03:04.909830 12016 raft_consensus.cc:493] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:03:04.909929 12016 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:04.911068 12016 raft_consensus.cc:515] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74d1a4ce4592454babe306de6de04429" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 33175 } }
I20251211 15:03:04.911473 12016 leader_election.cc:304] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74d1a4ce4592454babe306de6de04429; no voters: 
I20251211 15:03:04.911830 12016 leader_election.cc:290] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:03:04.912212 12021 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:04.912431 12021 raft_consensus.cc:697] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [term 1 LEADER]: Becoming Leader. State: Replica: 74d1a4ce4592454babe306de6de04429, State: Running, Role: LEADER
I20251211 15:03:04.912763 12021 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74d1a4ce4592454babe306de6de04429" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 33175 } }
I20251211 15:03:04.913094 12016 sys_catalog.cc:565] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:03:04.914546 12022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74d1a4ce4592454babe306de6de04429" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74d1a4ce4592454babe306de6de04429" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 33175 } } }
I20251211 15:03:04.914685 12022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:04.915004 12023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74d1a4ce4592454babe306de6de04429. Latest consensus state: current_term: 1 leader_uuid: "74d1a4ce4592454babe306de6de04429" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74d1a4ce4592454babe306de6de04429" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 33175 } } }
I20251211 15:03:04.915087 12023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:04.915217 12019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:04.902288 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44264 (local address 127.5.160.190:33175)
1211 15:03:04.902756 (+   468us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:04.902769 (+    13us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:04.902813 (+    44us) server_negotiation.cc:408] Connection header received
1211 15:03:04.903591 (+   778us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:04.903616 (+    25us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:04.903999 (+   383us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:04.904357 (+   358us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:04.905240 (+   883us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:04.906319 (+  1079us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:04.907030 (+   711us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:04.907330 (+   300us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:04.909658 (+  2328us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:04.909684 (+    26us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:04.909698 (+    14us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:04.909761 (+    63us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:04.911935 (+  2174us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:04.912587 (+   652us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:04.912593 (+     6us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:04.912598 (+     5us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:04.912702 (+   104us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:04.912989 (+   287us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:04.912992 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:04.912994 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:04.913463 (+   469us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:04.913674 (+   211us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:04.913983 (+   309us) server_negotiation.cc:300] Negotiation successful
1211 15:03:04.914293 (+   310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":131,"threads_started":1}
I20251211 15:03:04.915511 12031 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:03:04.918399 12031 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:03:04.923877 12031 catalog_manager.cc:1357] Generated new cluster ID: 8e9f64cb6b624b4496da36a1f9d8db7c
I20251211 15:03:04.923990 12031 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:03:04.937450 12031 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:03:04.938424 12031 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:03:04.948448 12031 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 74d1a4ce4592454babe306de6de04429: Generated new TSK 0
I20251211 15:03:04.949268 12031 catalog_manager.cc:1524] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:03:05.006877  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:33175
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:40943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:05.118508 12044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:05.118767 12044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:05.118847 12044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:05.122282 12044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:05.122362 12044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:05.122471 12044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:03:05.126971 12044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:40943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:33175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:05.128089 12044 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:05.128927 12044 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:05.135841 12050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:05.135926 12044 server_base.cc:1047] running on GCE node
W20251211 15:03:05.135850 12052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:05.135839 12049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:05.136420 12044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:05.136942 12044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:05.138144 12044 hybrid_clock.cc:648] HybridClock initialized: now 1765465385138094 us; error 40 us; skew 500 ppm
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:05.140865 12044 init.cc:377] Logged in from keytab as kudu/127.5.160.129@KRBTEST.COM (short username kudu)
I20251211 15:03:05.141932 12044 webserver.cc:492] Webserver started at http://127.5.160.129:33721/ using document root <none> and password file <none>
I20251211 15:03:05.142452 12044 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:05.142498 12044 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:05.142671 12044 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:05.144446 12044 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "20e5f864e4304baa90ed07028e95067b"
format_stamp: "Formatted at 2025-12-11 15:03:05 on dist-test-slave-4k3m"
server_key: "baf1ef7703bed771b1d8478a431db556"
server_key_iv: "c3bac0a8f58ec744d3a24f9a626bd6b0"
server_key_version: "encryptionkey@0"
I20251211 15:03:05.144906 12044 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "20e5f864e4304baa90ed07028e95067b"
format_stamp: "Formatted at 2025-12-11 15:03:05 on dist-test-slave-4k3m"
server_key: "baf1ef7703bed771b1d8478a431db556"
server_key_iv: "c3bac0a8f58ec744d3a24f9a626bd6b0"
server_key_version: "encryptionkey@0"
I20251211 15:03:05.148320 12044 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20251211 15:03:05.150599 12059 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:05.151847 12044 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:05.151962 12044 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "20e5f864e4304baa90ed07028e95067b"
format_stamp: "Formatted at 2025-12-11 15:03:05 on dist-test-slave-4k3m"
server_key: "baf1ef7703bed771b1d8478a431db556"
server_key_iv: "c3bac0a8f58ec744d3a24f9a626bd6b0"
server_key_version: "encryptionkey@0"
I20251211 15:03:05.152120 12044 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:05.164479 12044 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:05.167407 12044 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:05.167585 12044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:05.168147 12044 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:05.169034 12044 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:05.169081 12044 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:05.169123 12044 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:05.169152 12044 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:05.178253 12044 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:36065
I20251211 15:03:05.178277 12172 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:36065 every 8 connection(s)
I20251211 15:03:05.179301 12044 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:03:05.183446  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 12044
I20251211 15:03:05.183562  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:03:05.183775  5762 external_mini_cluster.cc:1468] Setting key 90dbc55d2994fd5b9bf26da069379f7c
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:03:05.193516 12019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:05.181029 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:37749 (local address 127.5.160.190:33175)
1211 15:03:05.181265 (+   236us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:05.181269 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:05.181915 (+   646us) server_negotiation.cc:408] Connection header received
1211 15:03:05.182777 (+   862us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:05.182781 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:05.182843 (+    62us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:05.182917 (+    74us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:05.184943 (+  2026us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.185589 (+   646us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:05.186501 (+   912us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.186729 (+   228us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:05.189355 (+  2626us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:05.189386 (+    31us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:05.189390 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:05.189430 (+    40us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:05.191288 (+  1858us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:05.191845 (+   557us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:05.191849 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:05.191852 (+     3us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:05.191923 (+    71us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:05.192242 (+   319us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:05.192245 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:05.192248 (+     3us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:05.192470 (+   222us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:05.192595 (+   125us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:05.193153 (+   558us) server_negotiation.cc:300] Negotiation successful
1211 15:03:05.193309 (+   156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
WARNING: no policy specified for kudu/127.5.160.130@KRBTEST.COM; defaulting to no policy
I20251211 15:03:05.194089 12175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:05.181309 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:33175 (local address 127.5.160.129:37749)
1211 15:03:05.181752 (+   443us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:05.181792 (+    40us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:05.182565 (+   773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:05.183175 (+   610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:05.183184 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:05.183649 (+   465us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:05.184710 (+  1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:05.184730 (+    20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.185744 (+  1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:05.185748 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:05.186327 (+   579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:05.186339 (+    12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.186595 (+   256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:05.187440 (+   845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:05.187470 (+    30us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:05.189057 (+  1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:05.191452 (+  2395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:05.191457 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:05.191470 (+    13us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:05.191732 (+   262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:05.192041 (+   309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:05.192043 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:05.192045 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:05.192147 (+   102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:05.192622 (+   475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:05.192628 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:05.192885 (+   257us) client_negotiation.cc:769] Sending connection context
1211 15:03:05.193074 (+   189us) client_negotiation.cc:240] Negotiation successful
1211 15:03:05.193339 (+   265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":101,"threads_started":1}
I20251211 15:03:05.195384 12173 heartbeater.cc:344] Connected to a master server at 127.5.160.190:33175
I20251211 15:03:05.195636 12173 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:05.196213 12173 heartbeater.cc:507] Master 127.5.160.190:33175 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.130@KRBTEST.COM" created.
I20251211 15:03:05.197742 11980 ts_manager.cc:194] Registered new tserver with Master: 20e5f864e4304baa90ed07028e95067b (127.5.160.129:36065)
I20251211 15:03:05.199265 11980 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:37749
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:03:05.234794  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:33175
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:40943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:05.343494 12180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:05.343753 12180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:05.343812 12180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:05.347296 12180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:05.347398 12180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:05.347502 12180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:03:05.352095 12180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:40943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:33175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:05.353246 12180 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:05.354110 12180 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:05.361212 12185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:05.361224 12186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:05.361362 12180 server_base.cc:1047] running on GCE node
W20251211 15:03:05.361202 12188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:05.361892 12180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:05.362514 12180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:05.363683 12180 hybrid_clock.cc:648] HybridClock initialized: now 1765465385363662 us; error 35 us; skew 500 ppm
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:05.366612 12180 init.cc:377] Logged in from keytab as kudu/127.5.160.130@KRBTEST.COM (short username kudu)
I20251211 15:03:05.367835 12180 webserver.cc:492] Webserver started at http://127.5.160.130:43107/ using document root <none> and password file <none>
I20251211 15:03:05.368443 12180 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:05.368501 12180 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:05.368692 12180 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:05.370754 12180 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "a70baed59ec24ec5b4862d68a449412f"
format_stamp: "Formatted at 2025-12-11 15:03:05 on dist-test-slave-4k3m"
server_key: "f80ee2d7d66f232514a856e9f9ca2813"
server_key_iv: "778710a894258f3effc0b870684feddd"
server_key_version: "encryptionkey@0"
I20251211 15:03:05.371342 12180 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "a70baed59ec24ec5b4862d68a449412f"
format_stamp: "Formatted at 2025-12-11 15:03:05 on dist-test-slave-4k3m"
server_key: "f80ee2d7d66f232514a856e9f9ca2813"
server_key_iv: "778710a894258f3effc0b870684feddd"
server_key_version: "encryptionkey@0"
I20251211 15:03:05.375253 12180 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20251211 15:03:05.377985 12195 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:05.379616 12180 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20251211 15:03:05.379761 12180 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "a70baed59ec24ec5b4862d68a449412f"
format_stamp: "Formatted at 2025-12-11 15:03:05 on dist-test-slave-4k3m"
server_key: "f80ee2d7d66f232514a856e9f9ca2813"
server_key_iv: "778710a894258f3effc0b870684feddd"
server_key_version: "encryptionkey@0"
I20251211 15:03:05.379873 12180 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:05.412611 12180 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:05.416322 12180 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:05.416512 12180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:05.417098 12180 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:05.418047 12180 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:05.418100 12180 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:05.418157 12180 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:05.418182 12180 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:05.427744 12180 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:36233
I20251211 15:03:05.427759 12308 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:36233 every 8 connection(s)
I20251211 15:03:05.428776 12180 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:03:05.431192  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 12180
I20251211 15:03:05.431288  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:03:05.431538  5762 external_mini_cluster.cc:1468] Setting key d224c8fdfc45090f3e827cc3d3e00239
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.160.131@KRBTEST.COM; defaulting to no policy
I20251211 15:03:05.442814 12019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:05.430569 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:58375 (local address 127.5.160.190:33175)
1211 15:03:05.430696 (+   127us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:05.430700 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:05.431458 (+   758us) server_negotiation.cc:408] Connection header received
1211 15:03:05.432319 (+   861us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:05.432322 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:05.432370 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:05.432438 (+    68us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:05.434139 (+  1701us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.434739 (+   600us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:05.435678 (+   939us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.435826 (+   148us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:05.438333 (+  2507us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:05.438361 (+    28us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:05.438365 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:05.438403 (+    38us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:05.440209 (+  1806us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:05.440803 (+   594us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:05.440807 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:05.440809 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:05.440875 (+    66us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:05.441267 (+   392us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:05.441271 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:05.441273 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:05.441691 (+   418us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:05.441819 (+   128us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:05.442551 (+   732us) server_negotiation.cc:300] Negotiation successful
1211 15:03:05.442683 (+   132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.131@KRBTEST.COM" created.
I20251211 15:03:05.443652 12311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:05.430828 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:33175 (local address 127.5.160.130:58375)
1211 15:03:05.431308 (+   480us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:05.431352 (+    44us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:05.432110 (+   758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:05.432611 (+   501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:05.432623 (+    12us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:05.433039 (+   416us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:05.433978 (+   939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:05.433992 (+    14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.434901 (+   909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:05.434905 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:05.435550 (+   645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:05.435561 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.435817 (+   256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:05.436470 (+   653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:05.436513 (+    43us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:05.438135 (+  1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:05.440381 (+  2246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:05.440387 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:05.440399 (+    12us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:05.440677 (+   278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:05.441008 (+   331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:05.441011 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:05.441012 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:05.441121 (+   109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:05.441889 (+   768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:05.441898 (+     9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:05.442293 (+   395us) client_negotiation.cc:769] Sending connection context
1211 15:03:05.442487 (+   194us) client_negotiation.cc:240] Negotiation successful
1211 15:03:05.442768 (+   281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":109,"threads_started":1}
I20251211 15:03:05.444856 12309 heartbeater.cc:344] Connected to a master server at 127.5.160.190:33175
I20251211 15:03:05.445197 12309 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:05.445765 12309 heartbeater.cc:507] Master 127.5.160.190:33175 requested a full tablet report, sending...
I20251211 15:03:05.446898 11980 ts_manager.cc:194] Registered new tserver with Master: a70baed59ec24ec5b4862d68a449412f (127.5.160.130:36233)
I20251211 15:03:05.447687 11980 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.130@KRBTEST.COM'} at 127.5.160.130:58375
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:03:05.480322  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:33175
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:40943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:05.588483 12316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:05.588732 12316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:05.588792 12316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:05.592295 12316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:05.592383 12316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:05.592473 12316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:03:05.597062 12316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:40943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:33175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:05.598227 12316 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:05.599119 12316 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:05.605980 12322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:05.606127 12324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:05.606033 12321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:05.606359 12316 server_base.cc:1047] running on GCE node
I20251211 15:03:05.606725 12316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:05.607365 12316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:05.608523 12316 hybrid_clock.cc:648] HybridClock initialized: now 1765465385608514 us; error 33 us; skew 500 ppm
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:05.611248 12316 init.cc:377] Logged in from keytab as kudu/127.5.160.131@KRBTEST.COM (short username kudu)
I20251211 15:03:05.612305 12316 webserver.cc:492] Webserver started at http://127.5.160.131:36869/ using document root <none> and password file <none>
I20251211 15:03:05.612826 12316 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:05.612870 12316 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:05.613031 12316 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:05.614838 12316 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "2aaeaba5849741618a96e73b796a9ca5"
format_stamp: "Formatted at 2025-12-11 15:03:05 on dist-test-slave-4k3m"
server_key: "15f3c1703e0e575f408ebf4848679ad5"
server_key_iv: "4e5fea8389a6343c24bfd728af97088c"
server_key_version: "encryptionkey@0"
I20251211 15:03:05.615345 12316 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "2aaeaba5849741618a96e73b796a9ca5"
format_stamp: "Formatted at 2025-12-11 15:03:05 on dist-test-slave-4k3m"
server_key: "15f3c1703e0e575f408ebf4848679ad5"
server_key_iv: "4e5fea8389a6343c24bfd728af97088c"
server_key_version: "encryptionkey@0"
I20251211 15:03:05.618718 12316 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20251211 15:03:05.621050 12331 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:05.622128 12316 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20251211 15:03:05.622232 12316 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "2aaeaba5849741618a96e73b796a9ca5"
format_stamp: "Formatted at 2025-12-11 15:03:05 on dist-test-slave-4k3m"
server_key: "15f3c1703e0e575f408ebf4848679ad5"
server_key_iv: "4e5fea8389a6343c24bfd728af97088c"
server_key_version: "encryptionkey@0"
I20251211 15:03:05.622331 12316 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:05.650298 12316 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:05.653323 12316 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:05.653494 12316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:05.654049 12316 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:05.654976 12316 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:05.655028 12316 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:05.655073 12316 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:05.655102 12316 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:05.664652 12316 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:46351
I20251211 15:03:05.664687 12444 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:46351 every 8 connection(s)
I20251211 15:03:05.665655 12316 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
I20251211 15:03:05.666385  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 12316
I20251211 15:03:05.666514  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:03:05.666769  5762 external_mini_cluster.cc:1468] Setting key 3fd9eb5a14247d756aa49562624db0ff
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:03:05.680393 12019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:05.667779 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:45987 (local address 127.5.160.190:33175)
1211 15:03:05.667941 (+   162us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:05.667945 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:05.668878 (+   933us) server_negotiation.cc:408] Connection header received
1211 15:03:05.669870 (+   992us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:05.669874 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:05.669929 (+    55us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:05.670014 (+    85us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:05.671726 (+  1712us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.672245 (+   519us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:05.672886 (+   641us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.673039 (+   153us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:05.675577 (+  2538us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:05.675616 (+    39us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:05.675618 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:05.675655 (+    37us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:05.677401 (+  1746us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:05.678032 (+   631us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:05.678036 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:05.678037 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:05.678094 (+    57us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:05.678468 (+   374us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:05.678472 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:05.678473 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:05.678663 (+   190us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:05.678763 (+   100us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:05.680036 (+  1273us) server_negotiation.cc:300] Negotiation successful
1211 15:03:05.680218 (+   182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20251211 15:03:05.681353 12447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:05.668171 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:33175 (local address 127.5.160.131:45987)
1211 15:03:05.668725 (+   554us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:05.668770 (+    45us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:05.669640 (+   870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:05.670173 (+   533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:05.670182 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:05.670579 (+   397us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:05.671563 (+   984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:05.671577 (+    14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.672352 (+   775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:05.672355 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:05.672770 (+   415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:05.672777 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.672972 (+   195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:05.673567 (+   595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:05.673594 (+    27us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:05.675345 (+  1751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:05.677581 (+  2236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:05.677587 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:05.677600 (+    13us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:05.677889 (+   289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:05.678191 (+   302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:05.678194 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:05.678196 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:05.678318 (+   122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:05.678830 (+   512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:05.678837 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:05.679610 (+   773us) client_negotiation.cc:769] Sending connection context
1211 15:03:05.679958 (+   348us) client_negotiation.cc:240] Negotiation successful
1211 15:03:05.680494 (+   536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":148,"threads_started":1}
I20251211 15:03:05.682615 12445 heartbeater.cc:344] Connected to a master server at 127.5.160.190:33175
I20251211 15:03:05.682864 12445 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:05.683445 12445 heartbeater.cc:507] Master 127.5.160.190:33175 requested a full tablet report, sending...
I20251211 15:03:05.684563 11980 ts_manager.cc:194] Registered new tserver with Master: 2aaeaba5849741618a96e73b796a9ca5 (127.5.160.131:46351)
I20251211 15:03:05.685200 11980 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.131@KRBTEST.COM'} at 127.5.160.131:45987
I20251211 15:03:05.694218  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/test-admin.keytab.
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:05.713346  5762 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20251211 15:03:05.716593 12452 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:05.715109 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59274 (local address 127.5.160.129:36065)
1211 15:03:05.715450 (+   341us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:05.715458 (+     8us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:05.715488 (+    30us) server_negotiation.cc:408] Connection header received
1211 15:03:05.715556 (+    68us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:05.715561 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:05.715736 (+   175us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:05.715859 (+   123us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:05.716435 (+   576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59274: BlockingRecv error: recv got EOF from 127.0.0.1:59274 (error 108)
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":70,"threads_started":1}
W20251211 15:03:05.716737  5762 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/krb5cc' of type FILE
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:05.717783  5762 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:05.718683  5762 init.cc:295] Successfully reacquired a new kerberos TGT
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.129@KRBTEST.COM
I20251211 15:03:05.728549 12452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:05.719733 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59288 (local address 127.5.160.129:36065)
1211 15:03:05.719875 (+   142us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:05.719879 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:05.719895 (+    16us) server_negotiation.cc:408] Connection header received
1211 15:03:05.720076 (+   181us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:05.720079 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:05.720129 (+    50us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:05.720204 (+    75us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:05.720890 (+   686us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.721714 (+   824us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:05.722482 (+   768us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.722726 (+   244us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:05.724892 (+  2166us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:05.724945 (+    53us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:05.724959 (+    14us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:05.724994 (+    35us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:05.726739 (+  1745us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:05.727370 (+   631us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:05.727375 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:05.727376 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:05.727443 (+    67us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:05.727660 (+   217us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:05.727662 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:05.727663 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:05.727859 (+   196us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:05.728040 (+   181us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:05.728230 (+   190us) server_negotiation.cc:300] Negotiation successful
1211 15:03:05.728379 (+   149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20251211 15:03:05.732565 12452 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:05.731475 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59304 (local address 127.5.160.129:36065)
1211 15:03:05.731602 (+   127us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:05.731606 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:05.731669 (+    63us) server_negotiation.cc:408] Connection header received
1211 15:03:05.731786 (+   117us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:05.731789 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:05.731839 (+    50us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:05.731902 (+    63us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:05.732375 (+   473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59304: BlockingRecv error: recv got EOF from 127.0.0.1:59304 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20251211 15:03:05.732671  5762 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/krb5cc' of type FILE
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:05.733733  5762 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:05.734589  5762 init.cc:295] Successfully reacquired a new kerberos TGT
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.129@KRBTEST.COM
I20251211 15:03:05.743992 12452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:05.735604 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59312 (local address 127.5.160.129:36065)
1211 15:03:05.735715 (+   111us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:05.735719 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:05.735854 (+   135us) server_negotiation.cc:408] Connection header received
1211 15:03:05.735906 (+    52us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:05.735909 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:05.735956 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:05.736029 (+    73us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:05.736704 (+   675us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.737275 (+   571us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:05.738066 (+   791us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.738260 (+   194us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:05.740597 (+  2337us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:05.740624 (+    27us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:05.740626 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:05.740661 (+    35us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:05.742279 (+  1618us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:05.742818 (+   539us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:05.742821 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:05.742823 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:05.742882 (+    59us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:05.743111 (+   229us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:05.743114 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:05.743115 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:05.743306 (+   191us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:05.743433 (+   127us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:05.743713 (+   280us) server_negotiation.cc:300] Negotiation successful
1211 15:03:05.743836 (+   123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20251211 15:03:05.747009  5762 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1765465326787564-5762-0/krb5kdc/krb5cc' of type FILE
W20251211 15:03:05.747030 12452 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:05.745998 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59320 (local address 127.5.160.129:36065)
1211 15:03:05.746186 (+   188us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:05.746190 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:05.746206 (+    16us) server_negotiation.cc:408] Connection header received
1211 15:03:05.746239 (+    33us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:05.746242 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:05.746281 (+    39us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:05.746359 (+    78us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:05.746859 (+   500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59320: BlockingRecv error: recv got EOF from 127.0.0.1:59320 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:05.748049  5762 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:05.748921  5762 init.cc:295] Successfully reacquired a new kerberos TGT
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[11932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.129@KRBTEST.COM
I20251211 15:03:05.756640 12452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:05.749847 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59336 (local address 127.5.160.129:36065)
1211 15:03:05.750005 (+   158us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:05.750010 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:05.750025 (+    15us) server_negotiation.cc:408] Connection header received
1211 15:03:05.750137 (+   112us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:05.750140 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:05.750183 (+    43us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:05.750264 (+    81us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:05.750797 (+   533us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.751317 (+   520us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:05.751889 (+   572us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:05.752024 (+   135us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:05.753894 (+  1870us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:05.753914 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:05.753916 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:05.753944 (+    28us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:05.755322 (+  1378us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:05.755704 (+   382us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:05.755707 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:05.755709 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:05.755752 (+    43us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:05.755926 (+   174us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:05.755928 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:05.755930 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:05.756060 (+   130us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:05.756159 (+    99us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:05.756377 (+   218us) server_negotiation.cc:300] Negotiation successful
1211 15:03:05.756477 (+   100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20251211 15:03:05.757673  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 12044
I20251211 15:03:05.762863  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 12180
I20251211 15:03:05.767887  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 12316
I20251211 15:03:05.772972  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 11948
2025-12-11T15:03:05Z chronyd exiting
[       OK ] SecurityITest.TestCorruptKerberosCC (3038 ms)
[ RUN      ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[12465](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[12465](info): set up 2 sockets
Dec 11 15:03:05 dist-test-slave-4k3m krb5kdc[12465](info): commencing operation
krb5kdc: starting...
W20251211 15:03:07.635713  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.841s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:03:07 dist-test-slave-4k3m krb5kdc[12465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465387, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:03:07Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:03:07Z Disabled control of system clock
WARNING: no policy specified for oryx/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal oryx/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
I20251211 15:03:07.785645  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:44329
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:44329
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:07.897957 12481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:07.898234 12481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:07.898313 12481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:07.901816 12481 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:03:07.901896 12481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:07.901935 12481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:07.901960 12481 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:03:07.901989 12481 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:03:07.906513 12481 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:44329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:44329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:07.907747 12481 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:07.908609 12481 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:07.914618 12489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:07.914700 12486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:07.914618 12487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:07.914963 12481 server_base.cc:1047] running on GCE node
I20251211 15:03:07.915575 12481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:07.916541 12481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:07.917725 12481 hybrid_clock.cc:648] HybridClock initialized: now 1765465387917695 us; error 46 us; skew 500 ppm
Dec 11 15:03:07 dist-test-slave-4k3m krb5kdc[12465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465387, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:07.920850 12481 init.cc:377] Logged in from keytab as oryx/127.5.160.190@KRBTEST.COM (short username oryx)
I20251211 15:03:07.922111 12481 webserver.cc:492] Webserver started at http://127.5.160.190:40881/ using document root <none> and password file <none>
I20251211 15:03:07.922672 12481 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:07.922726 12481 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:07.922919 12481 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:07.924757 12481 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "0299041a087e49eeaf7adbe9c2dd0756"
format_stamp: "Formatted at 2025-12-11 15:03:07 on dist-test-slave-4k3m"
server_key: "cf46e0eb43551ef06ae8d55e937f1db6"
server_key_iv: "3e4f17f42eeba786dda93a688ef52090"
server_key_version: "encryptionkey@0"
I20251211 15:03:07.925254 12481 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "0299041a087e49eeaf7adbe9c2dd0756"
format_stamp: "Formatted at 2025-12-11 15:03:07 on dist-test-slave-4k3m"
server_key: "cf46e0eb43551ef06ae8d55e937f1db6"
server_key_iv: "3e4f17f42eeba786dda93a688ef52090"
server_key_version: "encryptionkey@0"
I20251211 15:03:07.929044 12481 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20251211 15:03:07.931875 12496 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:07.933065 12481 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:07.933202 12481 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "0299041a087e49eeaf7adbe9c2dd0756"
format_stamp: "Formatted at 2025-12-11 15:03:07 on dist-test-slave-4k3m"
server_key: "cf46e0eb43551ef06ae8d55e937f1db6"
server_key_iv: "3e4f17f42eeba786dda93a688ef52090"
server_key_version: "encryptionkey@0"
I20251211 15:03:07.933306 12481 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:07.955819 12481 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:07.965070 12481 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:07.965305 12481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:07.973675 12481 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:44329
I20251211 15:03:07.973706 12548 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:44329 every 8 connection(s)
I20251211 15:03:07.974794 12481 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:03:07.977725 12549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:07.982177  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 12481
I20251211 15:03:07.982343  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:03:07.982568  5762 external_mini_cluster.cc:1468] Setting key e56ccac1697f34da40c2ff74b955379c
I20251211 15:03:07.984017 12549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756: Bootstrap starting.
I20251211 15:03:07.986260 12549 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:07.986997 12549 log.cc:826] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:07.989058 12549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756: No bootstrap required, opened a new log
Dec 11 15:03:07 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465387, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
I20251211 15:03:07.991855 12549 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } }
I20251211 15:03:07.992108 12549 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:07.992154 12549 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0299041a087e49eeaf7adbe9c2dd0756, State: Initialized, Role: FOLLOWER
I20251211 15:03:07.992636 12549 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } }
I20251211 15:03:07.992805 12549 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:03:07.992872 12549 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:03:07.992972 12549 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:07.994067 12549 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } }
I20251211 15:03:07.994465 12549 leader_election.cc:304] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0299041a087e49eeaf7adbe9c2dd0756; no voters: 
I20251211 15:03:07.994804 12549 leader_election.cc:290] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:03:07.995007 12554 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:07.995205 12554 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [term 1 LEADER]: Becoming Leader. State: Replica: 0299041a087e49eeaf7adbe9c2dd0756, State: Running, Role: LEADER
I20251211 15:03:07.995559 12554 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } }
I20251211 15:03:07.996115 12549 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:03:07.997234 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:07.984022 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47624 (local address 127.5.160.190:44329)
1211 15:03:07.984515 (+   493us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:07.984526 (+    11us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:07.984565 (+    39us) server_negotiation.cc:408] Connection header received
1211 15:03:07.985218 (+   653us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:07.985238 (+    20us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:07.985550 (+   312us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:07.985864 (+   314us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:07.986817 (+   953us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:07.987831 (+  1014us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:07.988650 (+   819us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:07.988987 (+   337us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:07.991344 (+  2357us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:07.991367 (+    23us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:07.991382 (+    15us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:07.991426 (+    44us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:07.993687 (+  2261us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:07.994224 (+   537us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:07.994231 (+     7us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:07.994237 (+     6us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:07.994345 (+   108us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:07.994611 (+   266us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:07.994614 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:07.994616 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:07.995122 (+   506us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:07.995911 (+   789us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:07.996088 (+   177us) server_negotiation.cc:300] Negotiation successful
1211 15:03:07.996424 (+   336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":160,"threads_started":1}
I20251211 15:03:07.997349 12555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } }
I20251211 15:03:07.997452 12555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:07.997319 12556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0299041a087e49eeaf7adbe9c2dd0756. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } }
I20251211 15:03:07.997792 12563 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:03:07.997797 12556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:08.000979 12563 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:03:08.006228 12563 catalog_manager.cc:1357] Generated new cluster ID: ef5f6ba1b13548aaa59b85d5085990c0
I20251211 15:03:08.006323 12563 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:03:08.018002 12563 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:03:08.019104 12563 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:03:08.028503 12563 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756: Generated new TSK 0
I20251211 15:03:08.029320 12563 catalog_manager.cc:1524] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal oryx/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
WARNING: no policy specified for HTTP/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
I20251211 15:03:08.085611  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:44329
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:08.215354 12577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:08.215612 12577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:08.215687 12577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:08.219393 12577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:08.219466 12577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:08.219549 12577 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:03:08.223960 12577 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:44329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:08.225029 12577 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:08.225836 12577 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:08.232641 12582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:08.232720 12577 server_base.cc:1047] running on GCE node
W20251211 15:03:08.232633 12585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:08.232630 12583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:08.233289 12577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:08.233850 12577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:08.235019 12577 hybrid_clock.cc:648] HybridClock initialized: now 1765465388235003 us; error 32 us; skew 500 ppm
Dec 11 15:03:08 dist-test-slave-4k3m krb5kdc[12465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465388, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:08.238008 12577 init.cc:377] Logged in from keytab as oryx/127.5.160.129@KRBTEST.COM (short username oryx)
I20251211 15:03:08.239265 12577 webserver.cc:492] Webserver started at http://127.5.160.129:40651/ using document root <none> and password file <none>
I20251211 15:03:08.239830 12577 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:08.239886 12577 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:08.240072 12577 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:08.242086 12577 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "d7461d2a9bca462b968a0041aeffac81"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "a0548d5923681cf08de1efc54958d8f8"
server_key_iv: "ef90b6cd3d8688c620909110ae78bb24"
server_key_version: "encryptionkey@0"
I20251211 15:03:08.242623 12577 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "d7461d2a9bca462b968a0041aeffac81"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "a0548d5923681cf08de1efc54958d8f8"
server_key_iv: "ef90b6cd3d8688c620909110ae78bb24"
server_key_version: "encryptionkey@0"
I20251211 15:03:08.246405 12577 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20251211 15:03:08.248939 12592 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:08.250195 12577 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20251211 15:03:08.250324 12577 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "d7461d2a9bca462b968a0041aeffac81"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "a0548d5923681cf08de1efc54958d8f8"
server_key_iv: "ef90b6cd3d8688c620909110ae78bb24"
server_key_version: "encryptionkey@0"
I20251211 15:03:08.250437 12577 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:08.266211 12577 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:08.269585 12577 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:08.269807 12577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:08.270411 12577 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:08.271430 12577 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:08.271487 12577 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:08.271545 12577 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:08.271576 12577 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:08.281018 12577 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:33625
I20251211 15:03:08.281064 12705 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:33625 every 8 connection(s)
I20251211 15:03:08.282061 12577 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:03:08.282555  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 12577
I20251211 15:03:08.282681  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:03:08.282963  5762 external_mini_cluster.cc:1468] Setting key 8a7ea773094236daa7cbc5ef6372f2d2
Dec 11 15:03:08 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465388, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
WARNING: no policy specified for oryx/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.160.130@KRBTEST.COM" created.
I20251211 15:03:08.296123 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:08.283855 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:58587 (local address 127.5.160.190:44329)
1211 15:03:08.284008 (+   153us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:08.284013 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:08.284955 (+   942us) server_negotiation.cc:408] Connection header received
1211 15:03:08.285713 (+   758us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:08.285717 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:08.285786 (+    69us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:08.285899 (+   113us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:08.288129 (+  2230us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:08.288642 (+   513us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:08.289564 (+   922us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:08.289744 (+   180us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:08.292442 (+  2698us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:08.292466 (+    24us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:08.292468 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:08.292498 (+    30us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:08.293908 (+  1410us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:08.294439 (+   531us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:08.294444 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:08.294446 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:08.294502 (+    56us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:08.294915 (+   413us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:08.294920 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:08.294921 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:08.295189 (+   268us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:08.295299 (+   110us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:08.295771 (+   472us) server_negotiation.cc:300] Negotiation successful
1211 15:03:08.295917 (+   146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20251211 15:03:08.296828 12708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:08.284223 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.129:58587)
1211 15:03:08.284712 (+   489us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:08.284754 (+    42us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:08.285519 (+   765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:08.286095 (+   576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:08.286107 (+    12us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:08.286662 (+   555us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:08.287937 (+  1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:08.287960 (+    23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:08.288786 (+   826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:08.288791 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:08.289394 (+   603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:08.289406 (+    12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:08.289726 (+   320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:08.290438 (+   712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:08.290475 (+    37us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:08.292274 (+  1799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:08.294029 (+  1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:08.294036 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:08.294049 (+    13us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:08.294342 (+   293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:08.294609 (+   267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:08.294613 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:08.294615 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:08.294762 (+   147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:08.295295 (+   533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:08.295301 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:08.295547 (+   246us) client_negotiation.cc:769] Sending connection context
1211 15:03:08.295725 (+   178us) client_negotiation.cc:240] Negotiation successful
1211 15:03:08.295968 (+   243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":128,"threads_started":1}
I20251211 15:03:08.298105 12706 heartbeater.cc:344] Connected to a master server at 127.5.160.190:44329
I20251211 15:03:08.298381 12706 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:08.298919 12706 heartbeater.cc:507] Master 127.5.160.190:44329 requested a full tablet report, sending...
I20251211 15:03:08.300515 12513 ts_manager.cc:194] Registered new tserver with Master: d7461d2a9bca462b968a0041aeffac81 (127.5.160.129:33625)
I20251211 15:03:08.301680 12513 master_service.cc:502] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:58587
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal oryx/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
WARNING: no policy specified for HTTP/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
I20251211 15:03:08.334365  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:44329
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:08.445070 12713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:08.445330 12713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:08.445399 12713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:08.448889 12713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:08.448975 12713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:08.449062 12713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:03:08.453763 12713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:44329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:08.454978 12713 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:08.455998 12713 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:08.462997 12719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:08.463152 12713 server_base.cc:1047] running on GCE node
W20251211 15:03:08.463002 12718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:08.462997 12721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:08.463711 12713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:08.464290 12713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:08.465478 12713 hybrid_clock.cc:648] HybridClock initialized: now 1765465388465465 us; error 31 us; skew 500 ppm
Dec 11 15:03:08 dist-test-slave-4k3m krb5kdc[12465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465388, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:08.468333 12713 init.cc:377] Logged in from keytab as oryx/127.5.160.130@KRBTEST.COM (short username oryx)
I20251211 15:03:08.469580 12713 webserver.cc:492] Webserver started at http://127.5.160.130:34825/ using document root <none> and password file <none>
I20251211 15:03:08.470366 12713 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:08.470448 12713 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:08.470661 12713 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:08.472625 12713 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "08e8b567337e43e685d75b1cf1e5c8ab"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "57a5961c1d6aaf1ce28b709b16004cee"
server_key_iv: "04931aa7d980247e356d10bcacc62730"
server_key_version: "encryptionkey@0"
I20251211 15:03:08.473145 12713 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "08e8b567337e43e685d75b1cf1e5c8ab"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "57a5961c1d6aaf1ce28b709b16004cee"
server_key_iv: "04931aa7d980247e356d10bcacc62730"
server_key_version: "encryptionkey@0"
I20251211 15:03:08.477011 12713 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20251211 15:03:08.479664 12728 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:08.480747 12713 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:08.480862 12713 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "08e8b567337e43e685d75b1cf1e5c8ab"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "57a5961c1d6aaf1ce28b709b16004cee"
server_key_iv: "04931aa7d980247e356d10bcacc62730"
server_key_version: "encryptionkey@0"
I20251211 15:03:08.480970 12713 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:08.504663 12713 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:08.507856 12713 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:08.508066 12713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:08.508670 12713 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:08.509574 12713 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:08.509624 12713 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:08.509676 12713 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:08.509716 12713 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:08.519045 12713 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:40275
I20251211 15:03:08.519140 12841 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:40275 every 8 connection(s)
I20251211 15:03:08.520032 12713 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:03:08.520687  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 12713
I20251211 15:03:08.520795  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:03:08.521090  5762 external_mini_cluster.cc:1468] Setting key 7d8fbc3637408536c8a15ab13c2a66c4
Dec 11 15:03:08 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465388, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
WARNING: no policy specified for oryx/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.160.131@KRBTEST.COM" created.
I20251211 15:03:08.534016 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:08.521844 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:42891 (local address 127.5.160.190:44329)
1211 15:03:08.521971 (+   127us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:08.521974 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:08.522882 (+   908us) server_negotiation.cc:408] Connection header received
1211 15:03:08.524020 (+  1138us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:08.524023 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:08.524073 (+    50us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:08.524159 (+    86us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:08.526247 (+  2088us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:08.526828 (+   581us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:08.527745 (+   917us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:08.527890 (+   145us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:08.530565 (+  2675us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:08.530589 (+    24us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:08.530593 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:08.530624 (+    31us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:08.532016 (+  1392us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:08.532520 (+   504us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:08.532523 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:08.532526 (+     3us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:08.532580 (+    54us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:08.532854 (+   274us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:08.532857 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:08.532860 (+     3us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:08.533046 (+   186us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:08.533129 (+    83us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:08.533708 (+   579us) server_negotiation.cc:300] Negotiation successful
1211 15:03:08.533826 (+   118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20251211 15:03:08.534766 12844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:08.522236 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.130:42891)
1211 15:03:08.522746 (+   510us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:08.522793 (+    47us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:08.523768 (+   975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:08.524335 (+   567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:08.524348 (+    13us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:08.524804 (+   456us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:08.526063 (+  1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:08.526082 (+    19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:08.527003 (+   921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:08.527007 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:08.527607 (+   600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:08.527618 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:08.527869 (+   251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:08.528551 (+   682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:08.528586 (+    35us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:08.530383 (+  1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:08.532139 (+  1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:08.532145 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:08.532157 (+    12us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:08.532420 (+   263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:08.532661 (+   241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:08.532664 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:08.532665 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:08.532765 (+   100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:08.533153 (+   388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:08.533161 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:08.533430 (+   269us) client_negotiation.cc:769] Sending connection context
1211 15:03:08.533667 (+   237us) client_negotiation.cc:240] Negotiation successful
1211 15:03:08.533964 (+   297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":129,"threads_started":1}
I20251211 15:03:08.535905 12842 heartbeater.cc:344] Connected to a master server at 127.5.160.190:44329
I20251211 15:03:08.536137 12842 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:08.536674 12842 heartbeater.cc:507] Master 127.5.160.190:44329 requested a full tablet report, sending...
I20251211 15:03:08.537703 12513 ts_manager.cc:194] Registered new tserver with Master: 08e8b567337e43e685d75b1cf1e5c8ab (127.5.160.130:40275)
I20251211 15:03:08.538465 12513 master_service.cc:502] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.160.130@KRBTEST.COM'} at 127.5.160.130:42891
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal oryx/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
WARNING: no policy specified for HTTP/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
I20251211 15:03:08.575222  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:44329
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:08.684235 12849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:08.684525 12849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:08.684608 12849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:08.688126 12849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:08.688218 12849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:08.688326 12849 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:03:08.692739 12849 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:44329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:08.693823 12849 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:08.694656 12849 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:08.701543 12855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:08.701543 12854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:08.701543 12857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:08.701722 12849 server_base.cc:1047] running on GCE node
I20251211 15:03:08.702199 12849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:08.702792 12849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:08.703966 12849 hybrid_clock.cc:648] HybridClock initialized: now 1765465388703947 us; error 42 us; skew 500 ppm
Dec 11 15:03:08 dist-test-slave-4k3m krb5kdc[12465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465388, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:08.706827 12849 init.cc:377] Logged in from keytab as oryx/127.5.160.131@KRBTEST.COM (short username oryx)
I20251211 15:03:08.708053 12849 webserver.cc:492] Webserver started at http://127.5.160.131:40425/ using document root <none> and password file <none>
I20251211 15:03:08.708648 12849 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:08.708703 12849 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:08.708954 12849 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:08.711316 12849 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "68b2237f121640b3a6b46e60e5274e0d"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "fe723f13dfa0d11dfe6beb330dd81115"
server_key_iv: "eb36902b321dba9a806fc03e80035bf0"
server_key_version: "encryptionkey@0"
I20251211 15:03:08.711958 12849 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "68b2237f121640b3a6b46e60e5274e0d"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "fe723f13dfa0d11dfe6beb330dd81115"
server_key_iv: "eb36902b321dba9a806fc03e80035bf0"
server_key_version: "encryptionkey@0"
I20251211 15:03:08.716686 12849 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20251211 15:03:08.719734 12864 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:08.721086 12849 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20251211 15:03:08.721220 12849 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "68b2237f121640b3a6b46e60e5274e0d"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "fe723f13dfa0d11dfe6beb330dd81115"
server_key_iv: "eb36902b321dba9a806fc03e80035bf0"
server_key_version: "encryptionkey@0"
I20251211 15:03:08.721345 12849 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:08.741941 12849 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:08.745396 12849 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:08.745579 12849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:08.746208 12849 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:08.747171 12849 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:08.747227 12849 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:08.747272 12849 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:08.747287 12849 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:08.756780 12849 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:43053
I20251211 15:03:08.756812 12977 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:43053 every 8 connection(s)
I20251211 15:03:08.757771 12849 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
I20251211 15:03:08.761478  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 12849
I20251211 15:03:08.761617  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:03:08.761826  5762 external_mini_cluster.cc:1468] Setting key d4581539f58afb37d441c11927f23b3f
Dec 11 15:03:08 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465388, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
I20251211 15:03:08.772086 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:08.759719 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:47019 (local address 127.5.160.190:44329)
1211 15:03:08.759852 (+   133us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:08.759905 (+    53us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:08.760556 (+   651us) server_negotiation.cc:408] Connection header received
1211 15:03:08.761466 (+   910us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:08.761470 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:08.761533 (+    63us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:08.761607 (+    74us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:08.763700 (+  2093us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:08.764398 (+   698us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:08.765334 (+   936us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:08.765508 (+   174us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:08.767909 (+  2401us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:08.767930 (+    21us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:08.767933 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:08.767966 (+    33us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:08.769547 (+  1581us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:08.770284 (+   737us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:08.770288 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:08.770289 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:08.770346 (+    57us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:08.770739 (+   393us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:08.770743 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:08.770744 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:08.771030 (+   286us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:08.771125 (+    95us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:08.771762 (+   637us) server_negotiation.cc:300] Negotiation successful
1211 15:03:08.771952 (+   190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20251211 15:03:08.772771 12980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:08.759910 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.131:47019)
1211 15:03:08.760407 (+   497us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:08.760444 (+    37us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:08.761260 (+   816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:08.761791 (+   531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:08.761800 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:08.762305 (+   505us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:08.763526 (+  1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:08.763545 (+    19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:08.764627 (+  1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:08.764631 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:08.765101 (+   470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:08.765110 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:08.765321 (+   211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:08.766058 (+   737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:08.766088 (+    30us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:08.767697 (+  1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:08.769726 (+  2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:08.769732 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:08.769745 (+    13us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:08.770151 (+   406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:08.770474 (+   323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:08.770478 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:08.770479 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:08.770612 (+   133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:08.771189 (+   577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:08.771195 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:08.771463 (+   268us) client_negotiation.cc:769] Sending connection context
1211 15:03:08.771674 (+   211us) client_negotiation.cc:240] Negotiation successful
1211 15:03:08.771940 (+   266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":109,"threads_started":1}
I20251211 15:03:08.774101 12978 heartbeater.cc:344] Connected to a master server at 127.5.160.190:44329
I20251211 15:03:08.774407 12978 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:08.775102 12978 heartbeater.cc:507] Master 127.5.160.190:44329 requested a full tablet report, sending...
I20251211 15:03:08.776212 12513 ts_manager.cc:194] Registered new tserver with Master: 68b2237f121640b3a6b46e60e5274e0d (127.5.160.131:43053)
I20251211 15:03:08.776788 12513 master_service.cc:502] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.160.131@KRBTEST.COM'} at 127.5.160.131:47019
I20251211 15:03:08.788331  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.5.160.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.160.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.160.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal oryx/127.5.160.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
WARNING: no policy specified for HTTP/127.5.160.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal HTTP/127.5.160.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
I20251211 15:03:08.843011  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.189:43525
--webserver_interface=127.5.160.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:44329,127.5.160.189:43525
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:08.953672 12985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:08.953939 12985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:08.954001 12985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:08.957530 12985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:03:08.957610 12985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:08.957633 12985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:08.957651 12985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:03:08.957667 12985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:03:08.962248 12985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:44329,127.5.160.189:43525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.189:43525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.160.189
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
W20251211 15:03:08.962492 12985 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.5.160.190:44329,127.5.160.189:43525'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20251211 15:03:08.963457 12985 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:08.964324 12985 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:08.970052 12991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:08.970191 12985 server_base.cc:1047] running on GCE node
W20251211 15:03:08.970006 12990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:08.970006 12993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:08.970887 12985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:08.971923 12985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:08.973096 12985 hybrid_clock.cc:648] HybridClock initialized: now 1765465388973096 us; error 42 us; skew 500 ppm
Dec 11 15:03:08 dist-test-slave-4k3m krb5kdc[12465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465388, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:08.975837 12985 init.cc:377] Logged in from keytab as oryx/127.5.160.189@KRBTEST.COM (short username oryx)
I20251211 15:03:08.976920 12985 webserver.cc:492] Webserver started at http://127.5.160.189:33817/ using document root <none> and password file <none>
I20251211 15:03:08.977470 12985 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:08.977520 12985 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:08.977705 12985 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:08.979568 12985 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/data/instance:
uuid: "d5d5706f9b8549af870a01843f6bc054"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "ce67e0a42055c4227a329fe66092282f"
server_key_iv: "59727b4c027ab0991b35f41390b375f5"
server_key_version: "encryptionkey@0"
I20251211 15:03:08.980046 12985 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/wal/instance:
uuid: "d5d5706f9b8549af870a01843f6bc054"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "ce67e0a42055c4227a329fe66092282f"
server_key_iv: "59727b4c027ab0991b35f41390b375f5"
server_key_version: "encryptionkey@0"
I20251211 15:03:08.983541 12985 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20251211 15:03:08.985906 13000 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:08.987177 12985 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20251211 15:03:08.987304 12985 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/wal
uuid: "d5d5706f9b8549af870a01843f6bc054"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "ce67e0a42055c4227a329fe66092282f"
server_key_iv: "59727b4c027ab0991b35f41390b375f5"
server_key_version: "encryptionkey@0"
I20251211 15:03:08.987406 12985 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:09.005434 12985 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:09.008651 12985 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:09.008828 12985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:09.016508 12985 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.189:43525
I20251211 15:03:09.016538 13052 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.189:43525 every 8 connection(s)
I20251211 15:03:09.017606 12985 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/data/info.pb
I20251211 15:03:09.018882  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 12985
I20251211 15:03:09.020797 13053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:09.024770 13053 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } has no permanent_uuid. Determining permanent_uuid...
Dec 11 15:03:09 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465387, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.160.189@KRBTEST.COM
Dec 11 15:03:09 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465388, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.189@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
I20251211 15:03:09.033349 13056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.020268 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35740 (local address 127.5.160.189:43525)
1211 15:03:09.020660 (+   392us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.020671 (+    11us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.020707 (+    36us) server_negotiation.cc:408] Connection header received
1211 15:03:09.021830 (+  1123us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.021853 (+    23us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.022182 (+   329us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.022488 (+   306us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.023664 (+  1176us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.024505 (+   841us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.025354 (+   849us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.025585 (+   231us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.028082 (+  2497us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.028137 (+    55us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.028148 (+    11us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.028187 (+    39us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.030467 (+  2280us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.030877 (+   410us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.030883 (+     6us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.030890 (+     7us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.031007 (+   117us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.031344 (+   337us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.031348 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.031350 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.031730 (+   380us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.031914 (+   184us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.032251 (+   337us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.032527 (+   276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":114,"threads_started":1}
I20251211 15:03:09.036082 13057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.026610 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:47630)
1211 15:03:09.027204 (+   594us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.027246 (+    42us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.027373 (+   127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.027712 (+   339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.027718 (+     6us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.028179 (+   461us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:09.028469 (+   290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.028477 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.029367 (+   890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.029371 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.029951 (+   580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.029961 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.030082 (+   121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.030571 (+   489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:09.030588 (+    17us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:09.032098 (+  1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:09.034197 (+  2099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.034204 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.034207 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.034414 (+   207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.034708 (+   294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.034711 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.034713 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.034772 (+    59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.035446 (+   674us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:09.035453 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:09.035574 (+   121us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.035766 (+   192us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.035932 (+   166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":111,"threads_started":1}
I20251211 15:03:09.036135 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.026709 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47630 (local address 127.5.160.190:44329)
1211 15:03:09.026860 (+   151us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.026865 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.027339 (+   474us) server_negotiation.cc:408] Connection header received
1211 15:03:09.027461 (+   122us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.027465 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.027520 (+    55us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.027606 (+    86us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.028600 (+   994us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.029252 (+   652us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.030079 (+   827us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.030237 (+   158us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.032244 (+  2007us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.032269 (+    25us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.032273 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.032305 (+    32us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.034044 (+  1739us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.034523 (+   479us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.034527 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.034529 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.034585 (+    56us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.035017 (+   432us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.035020 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.035022 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.035286 (+   264us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.035397 (+   111us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.035864 (+   467us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.035979 (+   115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20251211 15:03:09.037340 13053 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } has no permanent_uuid. Determining permanent_uuid...
Dec 11 15:03:09 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465388, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.189@KRBTEST.COM for oryx/127.5.160.189@KRBTEST.COM
I20251211 15:03:09.044788 13057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.037851 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.189:43525 (local address 127.0.0.1:35754)
1211 15:03:09.037990 (+   139us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.038004 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.038074 (+    70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.038281 (+   207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.038283 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.038420 (+   137us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:09.038597 (+   177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.038602 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.039374 (+   772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.039377 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.039734 (+   357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.039741 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.039838 (+    97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.040346 (+   508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:09.040359 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:09.041666 (+  1307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:09.043471 (+  1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.043474 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.043475 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.043648 (+   173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.043863 (+   215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.043866 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.043867 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.043915 (+    48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.044306 (+   391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:09.044309 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:09.044393 (+    84us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.044490 (+    97us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.044603 (+   113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20251211 15:03:09.044800 13056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.037895 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35754 (local address 127.5.160.189:43525)
1211 15:03:09.038048 (+   153us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.038051 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.038063 (+    12us) server_negotiation.cc:408] Connection header received
1211 15:03:09.038162 (+    99us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.038164 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.038201 (+    37us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.038261 (+    60us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.038694 (+   433us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.039249 (+   555us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.039861 (+   612us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.040026 (+   165us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.041809 (+  1783us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.041827 (+    18us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.041829 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.041852 (+    23us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.043352 (+  1500us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.043728 (+   376us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.043731 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.043732 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.043768 (+    36us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.044027 (+   259us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.044030 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.044031 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.044194 (+   163us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.044284 (+    90us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.044562 (+   278us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.044659 (+    97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20251211 15:03:09.047571 13053 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: Bootstrap starting.
I20251211 15:03:09.050153 13053 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:09.050907 13053 log.cc:826] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:09.052901 13053 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: No bootstrap required, opened a new log
I20251211 15:03:09.055581 13053 raft_consensus.cc:359] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } }
I20251211 15:03:09.055768 13053 raft_consensus.cc:385] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:09.055824 13053 raft_consensus.cc:740] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5d5706f9b8549af870a01843f6bc054, State: Initialized, Role: FOLLOWER
I20251211 15:03:09.056243 13053 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } }
I20251211 15:03:09.056704 13059 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } } }
I20251211 15:03:09.056833 13059 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: This master's current role is: FOLLOWER
I20251211 15:03:09.057336 13053 sys_catalog.cc:565] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: configured and running, proceeding with master startup.
W20251211 15:03:09.062306 13070 catalog_manager.cc:1568] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251211 15:03:09.062450 13070 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251211 15:03:09.064311 12985 master_runner.cc:428] Detected that this master d5d5706f9b8549af870a01843f6bc054 is joining an existing cluster
I20251211 15:03:09.064380 12985 master_runner.cc:432] Initiating AddMaster RPC to add 127.5.160.189:43525
I20251211 15:03:09.073482 13076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.066407 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:47640)
1211 15:03:09.067060 (+   653us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.067073 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.067227 (+   154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.067570 (+   343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.067573 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.067776 (+   203us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:09.068029 (+   253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.068035 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.069006 (+   971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.069010 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.069388 (+   378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.069395 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.069496 (+   101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.070110 (+   614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:09.070124 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:09.070425 (+   301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:09.072182 (+  1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.072186 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.072188 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.072354 (+   166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.072571 (+   217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.072574 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.072575 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.072621 (+    46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.072954 (+   333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:09.072957 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:09.073040 (+    83us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.073128 (+    88us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.073274 (+   146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":106,"threads_started":1}
I20251211 15:03:09.073470 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.066492 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47640 (local address 127.5.160.190:44329)
1211 15:03:09.066668 (+   176us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.066673 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.067144 (+   471us) server_negotiation.cc:408] Connection header received
1211 15:03:09.067339 (+   195us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.067343 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.067395 (+    52us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.067473 (+    78us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.068165 (+   692us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.068914 (+   749us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.069496 (+   582us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.069679 (+   183us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.070583 (+   904us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.070601 (+    18us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.070603 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.070628 (+    25us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.072069 (+  1441us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.072441 (+   372us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.072445 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.072446 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.072491 (+    45us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.072695 (+   204us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.072699 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.072701 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.072860 (+   159us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.072947 (+    87us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.073196 (+   249us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.073317 (+   121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
Dec 11 15:03:09 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465387, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.190@KRBTEST.COM for oryx/127.5.160.189@KRBTEST.COM
I20251211 15:03:09.091473 13056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.066853 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35762 (local address 127.5.160.189:43525)
1211 15:03:09.066993 (+   140us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.066997 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.067135 (+   138us) server_negotiation.cc:408] Connection header received
1211 15:03:09.067259 (+   124us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.067262 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.067303 (+    41us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.067371 (+    68us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.068169 (+   798us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.068841 (+   672us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.069642 (+   801us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.069822 (+   180us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.088138 (+ 18316us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.088158 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.088161 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.088198 (+    37us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.089744 (+  1546us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.090295 (+   551us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.090300 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.090302 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.090357 (+    55us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.090574 (+   217us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.090577 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.090579 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.090811 (+   232us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.090900 (+    89us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.091171 (+   271us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.091324 (+   153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":55}
I20251211 15:03:09.091485 13077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.066781 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.189:43525 (local address 127.0.0.1:35762)
1211 15:03:09.067048 (+   267us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.067060 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.067164 (+   104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.067402 (+   238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.067405 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.067706 (+   301us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:09.068071 (+   365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.068081 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.068954 (+   873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.068959 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.069518 (+   559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.069529 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.069957 (+   428us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.087506 (+ 17549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:09.087525 (+    19us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:09.087999 (+   474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:09.089859 (+  1860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.089863 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.089865 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.090167 (+   302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.090436 (+   269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.090438 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.090440 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.090494 (+    54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.090897 (+   403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:09.090900 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:09.091030 (+   130us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.091117 (+    87us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.091268 (+   151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":73,"threads_started":1}
I20251211 15:03:09.092304 13078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.078175 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.189:43525 (local address 127.0.0.1:35764)
1211 15:03:09.078517 (+   342us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.078554 (+    37us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.078703 (+   149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.079078 (+   375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.079083 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.079496 (+   413us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:09.079714 (+   218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.079721 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.081101 (+  1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.081104 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.081491 (+   387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.081499 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.081601 (+   102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.082187 (+   586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:09.082201 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:09.083944 (+  1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:09.090401 (+  6457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.090418 (+    17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.090425 (+     7us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.090751 (+   326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.091011 (+   260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.091015 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.091017 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.091081 (+    64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.091622 (+   541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:09.091630 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:09.091767 (+   137us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.091933 (+   166us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.092120 (+   187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":81,"threads_started":1}
I20251211 15:03:09.093185 13079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.078233 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35764 (local address 127.5.160.189:43525)
1211 15:03:09.078543 (+   310us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.078548 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.078634 (+    86us) server_negotiation.cc:408] Connection header received
1211 15:03:09.078839 (+   205us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.078843 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.078904 (+    61us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.079028 (+   124us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.079831 (+   803us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.080944 (+  1113us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.081595 (+   651us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.081819 (+   224us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.084101 (+  2282us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.084127 (+    26us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.084131 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.084171 (+    40us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.090290 (+  6119us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.090844 (+   554us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.090848 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.090850 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.090897 (+    47us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.091197 (+   300us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.091200 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.091202 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.091342 (+   140us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.091415 (+    73us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.092851 (+  1436us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.092996 (+   145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":129,"threads_started":1}
I20251211 15:03:09.094413 12513 catalog_manager.cc:7141] Initiating ChangeConfig request to add master 127.5.160.189:43525: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
  permanent_uuid: "d5d5706f9b8549af870a01843f6bc054"
  member_type: NON_VOTER
  last_known_addr {
    host: "127.5.160.189"
    port: 43525
  }
  attrs {
    promote: true
  }
}
dest_uuid: "0299041a087e49eeaf7adbe9c2dd0756"
cas_config_opid_index: -1
I20251211 15:03:09.095060 12513 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: NON_VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: true } }
WARNING: no policy specified for oryx/127.5.160.188@KRBTEST.COM; defaulting to no policy
I20251211 15:03:09.096982 13082 raft_consensus.cc:2955] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER d5d5706f9b8549af870a01843f6bc054 (127.5.160.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: NON_VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: true } } }
I20251211 15:03:09.097836 13027 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:09.098910 13082 catalog_manager.cc:7145] Successfully completed master ChangeConfig request to add master 127.5.160.189:43525
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.160.188@KRBTEST.COM" created.
I20251211 15:03:09.099141 13083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: NON_VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: true } } }
I20251211 15:03:09.099313 13083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:09.099540 12985 master.cc:561] Master@127.5.160.189:43525 shutting down...
I20251211 15:03:09.101576 13027 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 FOLLOWER]: Refusing update from remote peer 0299041a087e49eeaf7adbe9c2dd0756: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20251211 15:03:09.102361 13083 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: NON_VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20251211 15:03:09.104399 12498 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20251211 15:03:09.105345 12498 consensus_peers.cc:597] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 -> Peer d5d5706f9b8549af870a01843f6bc054 (127.5.160.189:43525): Couldn't send request to peer d5d5706f9b8549af870a01843f6bc054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20251211 15:03:09.106168 12985 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:03:09.106437 12985 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:09.106531 12985 tablet_replica.cc:333] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.160.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal oryx/127.5.160.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
I20251211 15:03:09.121308 12985 master.cc:583] Master@127.5.160.189:43525 shutdown complete.
I20251211 15:03:09.121383 12985 master_runner.cc:305] Clearing existing system tablet
I20251211 15:03:09.121610 12985 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:09.121662 12985 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:09.123100 12985 fs_manager.cc:714] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20251211 15:03:09.124066 13089 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:09.124320 12985 fs_report.cc:389] FS layout report
--------------------
wal directory: 
metadata directory: 
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
WARNING: no policy specified for HTTP/127.5.160.188@KRBTEST.COM; defaulting to no policy
I20251211 15:03:09.124449 12985 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20251211 15:03:09.124482 12985 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/wal
uuid: "d5d5706f9b8549af870a01843f6bc054"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "ce67e0a42055c4227a329fe66092282f"
server_key_iv: "59727b4c027ab0991b35f41390b375f5"
server_key_version: "encryptionkey@0"
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.188@KRBTEST.COM" created.
I20251211 15:03:09.126688 12985 ts_tablet_manager.cc:1916] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:09.128983 12985 ts_tablet_manager.cc:1929] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20251211 15:03:09.129078 12985 log.cc:1199] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20251211 15:03:09.129405 12985 ts_tablet_manager.cc:1950] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: Deleting consensus metadata
I20251211 15:03:09.129568 12985 master_runner.cc:315] Copying system tablet from 127.5.160.190:44329
I20251211 15:03:09.130800 12985 tablet_copy_client.cc:323] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: tablet copy: Beginning tablet copy session from remote peer at address 127.5.160.190:44329
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal HTTP/127.5.160.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab.
I20251211 15:03:09.142714  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.188:35895
--webserver_interface=127.5.160.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:44329,127.5.160.189:43525,127.5.160.188:35895
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20251211 15:03:09.144213 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.131556 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47654 (local address 127.5.160.190:44329)
1211 15:03:09.131694 (+   138us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.131699 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.132223 (+   524us) server_negotiation.cc:408] Connection header received
1211 15:03:09.132374 (+   151us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.132378 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.132443 (+    65us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.132531 (+    88us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.133230 (+   699us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.134026 (+   796us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.134722 (+   696us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.134951 (+   229us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.135734 (+   783us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.135756 (+    22us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.135759 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.135787 (+    28us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.142227 (+  6440us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.142855 (+   628us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.142859 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.142862 (+     3us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.142922 (+    60us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.143253 (+   331us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.143257 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.143259 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.143462 (+   203us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.143535 (+    73us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.143892 (+   357us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.144035 (+   143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20251211 15:03:09.144356 13096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.131804 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:47654)
1211 15:03:09.132102 (+   298us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.132119 (+    17us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.132272 (+   153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.132568 (+   296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.132571 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.132774 (+   203us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:09.133095 (+   321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.133106 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.134150 (+  1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.134159 (+     9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.134615 (+   456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.134625 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.134723 (+    98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.135319 (+   596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:09.135333 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:09.135618 (+   285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:09.142442 (+  6824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.142447 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.142449 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.142717 (+   268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.143032 (+   315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.143036 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.143038 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.143125 (+    87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.143609 (+   484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:09.143612 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:09.143706 (+    94us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.143807 (+   101us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.143984 (+   177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":104,"threads_started":1}
I20251211 15:03:09.145287 12533 tablet_copy_service.cc:140] P 0299041a087e49eeaf7adbe9c2dd0756: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer d5d5706f9b8549af870a01843f6bc054 ({username='oryx', principal='oryx/127.5.160.189@KRBTEST.COM'} at 127.0.0.1:47654)
I20251211 15:03:09.145459 12533 tablet_copy_service.cc:161] P 0299041a087e49eeaf7adbe9c2dd0756: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer d5d5706f9b8549af870a01843f6bc054 at {username='oryx', principal='oryx/127.5.160.189@KRBTEST.COM'} at 127.0.0.1:47654: session id = d5d5706f9b8549af870a01843f6bc054-00000000000000000000000000000000
I20251211 15:03:09.147130 12533 tablet_copy_source_session.cc:215] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 15:03:09.149101 12985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20251211 15:03:09.151889 12985 tablet_copy_client.cc:806] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: tablet copy: Starting download of 0 data blocks...
I20251211 15:03:09.152139 12985 tablet_copy_client.cc:670] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: tablet copy: Starting download of 1 WAL segments...
I20251211 15:03:09.154868 12985 tablet_copy_client.cc:538] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 15:03:09.157410 12533 tablet_copy_service.cc:342] P 0299041a087e49eeaf7adbe9c2dd0756: Request end of tablet copy session d5d5706f9b8549af870a01843f6bc054-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.5.160.189@KRBTEST.COM'} at 127.0.0.1:47654
I20251211 15:03:09.157565 12533 tablet_copy_service.cc:434] P 0299041a087e49eeaf7adbe9c2dd0756: ending tablet copy session d5d5706f9b8549af870a01843f6bc054-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer d5d5706f9b8549af870a01843f6bc054
W20251211 15:03:09.163089 12985 builtin_ntp.cc:688] coult not shutdown socket: Network error: shutdown error: Transport endpoint is not connected (error 107)
I20251211 15:03:09.166182 12985 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:09.168368 13101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:09.168390 13098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:09.168834 13099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:09.169010 12985 server_base.cc:1047] running on GCE node
I20251211 15:03:09.169183 12985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:09.169513 12985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:09.170683 12985 hybrid_clock.cc:648] HybridClock initialized: now 1765465389170670 us; error 33 us; skew 500 ppm
Dec 11 15:03:09 dist-test-slave-4k3m krb5kdc[12465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465389, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:09.172434 12985 init.cc:377] Logged in from keytab as oryx/127.5.160.189@KRBTEST.COM (short username oryx)
I20251211 15:03:09.172969 12985 webserver.cc:492] Webserver started at http://127.5.160.189:38879/ using document root <none> and password file <none>
I20251211 15:03:09.173175 12985 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:09.173218 12985 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:09.174597 12985 fs_manager.cc:714] Time spent opening directory manager: real 0.001s	user 0.000s	sys 0.001s
I20251211 15:03:09.175787 13108 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:09.176080 12985 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20251211 15:03:09.176203 12985 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/wal
uuid: "d5d5706f9b8549af870a01843f6bc054"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "ce67e0a42055c4227a329fe66092282f"
server_key_iv: "59727b4c027ab0991b35f41390b375f5"
server_key_version: "encryptionkey@0"
I20251211 15:03:09.176349 12985 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:09.185379 12985 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:09.187803 12985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:09.192502 12985 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.189:43525
I20251211 15:03:09.193127 12985 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-1/data/info.pb
I20251211 15:03:09.193571 13160 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.189:43525 every 8 connection(s)
I20251211 15:03:09.195603 13161 sys_catalog.cc:263] Verifying existing consensus state
I20251211 15:03:09.196708 13161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: Bootstrap starting.
I20251211 15:03:09.208429 13161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 15:03:09.208923 13161 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: Bootstrap complete.
I20251211 15:03:09.209743 13161 raft_consensus.cc:359] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: NON_VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: true } }
I20251211 15:03:09.209978 13161 raft_consensus.cc:740] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d5d5706f9b8549af870a01843f6bc054, State: Initialized, Role: LEARNER
I20251211 15:03:09.210131 13161 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: NON_VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: true } }
I20251211 15:03:09.210609 13164 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: NON_VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: true } } }
I20251211 15:03:09.210793 13164 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: This master's current role is: LEARNER
I20251211 15:03:09.210850 13161 sys_catalog.cc:565] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:03:09.213919 13175 catalog_manager.cc:1269] Loaded cluster ID: ef5f6ba1b13548aaa59b85d5085990c0
I20251211 15:03:09.214044 13175 catalog_manager.cc:1562] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: loading cluster ID for follower catalog manager: success
I20251211 15:03:09.216347 13175 catalog_manager.cc:1584] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: acquiring CA information for follower catalog manager: success
I20251211 15:03:09.217885 13175 catalog_manager.cc:1612] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20251211 15:03:09.272466 13097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:09.272735 13097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:09.272814 13097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:09.276321 13097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:03:09.276407 13097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:09.276438 13097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:09.276460 13097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:03:09.276484 13097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:03:09.281239 13097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:44329,127.5.160.189:43525,127.5.160.188:35895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.188:35895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.160.188
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:09.282338 13097 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:09.283239 13097 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:09.289186 13183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:09.289199 13180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:09.289186 13181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:09.289412 13097 server_base.cc:1047] running on GCE node
I20251211 15:03:09.289988 13097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:09.290975 13097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:09.292196 13097 hybrid_clock.cc:648] HybridClock initialized: now 1765465389292169 us; error 45 us; skew 500 ppm
Dec 11 15:03:09 dist-test-slave-4k3m krb5kdc[12465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465389, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:09.295305 13097 init.cc:377] Logged in from keytab as oryx/127.5.160.188@KRBTEST.COM (short username oryx)
I20251211 15:03:09.296474 13097 webserver.cc:492] Webserver started at http://127.5.160.188:41437/ using document root <none> and password file <none>
I20251211 15:03:09.297072 13097 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:09.297127 13097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:09.297302 13097 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:09.299279 13097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/data/instance:
uuid: "b36fb0f4f5d140f5a34f891811372f74"
format_stamp: "Formatted at 2025-12-11 15:03:09 on dist-test-slave-4k3m"
server_key: "6eae7e2c1722a1587fc430abcfa53b61"
server_key_iv: "fe1bf555e9721c171cafad1e3d12b0a7"
server_key_version: "encryptionkey@0"
I20251211 15:03:09.299763 13097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/wal/instance:
uuid: "b36fb0f4f5d140f5a34f891811372f74"
format_stamp: "Formatted at 2025-12-11 15:03:09 on dist-test-slave-4k3m"
server_key: "6eae7e2c1722a1587fc430abcfa53b61"
server_key_iv: "fe1bf555e9721c171cafad1e3d12b0a7"
server_key_version: "encryptionkey@0"
I20251211 15:03:09.303496 13097 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20251211 15:03:09.304344 12706 heartbeater.cc:499] Master 127.5.160.190:44329 was elected leader, sending a full tablet report...
I20251211 15:03:09.306354 13190 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:09.307586 13097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20251211 15:03:09.307708 13097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/wal
uuid: "b36fb0f4f5d140f5a34f891811372f74"
format_stamp: "Formatted at 2025-12-11 15:03:09 on dist-test-slave-4k3m"
server_key: "6eae7e2c1722a1587fc430abcfa53b61"
server_key_iv: "fe1bf555e9721c171cafad1e3d12b0a7"
server_key_version: "encryptionkey@0"
I20251211 15:03:09.307808 13097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:09.317859 13097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:09.321317 13097 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:09.321484 13097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:09.328595 13242 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.188:35895 every 8 connection(s)
I20251211 15:03:09.328598 13097 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.188:35895
I20251211 15:03:09.329674 13097 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/data/info.pb
I20251211 15:03:09.332756 13243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:09.336915 13243 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } has no permanent_uuid. Determining permanent_uuid...
I20251211 15:03:09.339521  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 13097
Dec 11 15:03:09 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465389, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.188@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
Dec 11 15:03:09 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465387, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.160.188@KRBTEST.COM
I20251211 15:03:09.349845 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.338889 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47662 (local address 127.5.160.190:44329)
1211 15:03:09.339076 (+   187us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.339081 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.339718 (+   637us) server_negotiation.cc:408] Connection header received
1211 15:03:09.340713 (+   995us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.340717 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.340769 (+    52us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.340834 (+    65us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.342146 (+  1312us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.342658 (+   512us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.343384 (+   726us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.343589 (+   205us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.345886 (+  2297us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.345910 (+    24us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.345913 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.345956 (+    43us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.347562 (+  1606us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.348132 (+   570us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.348135 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.348137 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.348191 (+    54us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.348506 (+   315us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.348510 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.348513 (+     3us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.348733 (+   220us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.348840 (+   107us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.349518 (+   678us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.349652 (+   134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20251211 15:03:09.351082 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.340387 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53534 (local address 127.5.160.188:35895)
1211 15:03:09.340763 (+   376us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.340769 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.340802 (+    33us) server_negotiation.cc:408] Connection header received
1211 15:03:09.340944 (+   142us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.340950 (+     6us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.341139 (+   189us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.341296 (+   157us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.342076 (+   780us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.342770 (+   694us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.343671 (+   901us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.343860 (+   189us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.346281 (+  2421us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.346305 (+    24us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.346319 (+    14us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.346348 (+    29us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.348347 (+  1999us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.348851 (+   504us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.348856 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.348858 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.348988 (+   130us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.349309 (+   321us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.349313 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.349315 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.349520 (+   205us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.349710 (+   190us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.349953 (+   243us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.350187 (+   234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"spinlock_wait_cycles":1280,"thread_start_us":179,"threads_started":1}
I20251211 15:03:09.351082 13245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.339088 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:47662)
1211 15:03:09.339575 (+   487us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.339619 (+    44us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.340485 (+   866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.340987 (+   502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.340998 (+    11us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.341535 (+   537us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:09.341971 (+   436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.341985 (+    14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.342777 (+   792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.342781 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.343263 (+   482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.343272 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.343446 (+   174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.344059 (+   613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:09.344083 (+    24us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:09.345718 (+  1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:09.347684 (+  1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.347692 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.347704 (+    12us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.347993 (+   289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.348277 (+   284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.348281 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.348284 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.348391 (+   107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.348850 (+   459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:09.348858 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:09.349187 (+   329us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.349399 (+   212us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.349685 (+   286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":119,"threads_started":1}
I20251211 15:03:09.352492 13243 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } has no permanent_uuid. Determining permanent_uuid...
Dec 11 15:03:09 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465389, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.188@KRBTEST.COM for oryx/127.5.160.189@KRBTEST.COM
I20251211 15:03:09.360663 13245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.353021 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.189:43525 (local address 127.0.0.1:35780)
1211 15:03:09.353137 (+   116us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.353151 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.353215 (+    64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.353644 (+   429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.353647 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.353814 (+   167us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:09.354001 (+   187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.354008 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.354955 (+   947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.354959 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.355391 (+   432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.355400 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.355504 (+   104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.356098 (+   594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:09.356139 (+    41us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:09.357408 (+  1269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:09.359312 (+  1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.359316 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.359319 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.359473 (+   154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.359694 (+   221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.359697 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.359699 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.359742 (+    43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.360163 (+   421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:09.360167 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:09.360246 (+    79us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.360332 (+    86us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.360477 (+   145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20251211 15:03:09.360653 13247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.353159 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35780 (local address 127.5.160.189:43525)
1211 15:03:09.353451 (+   292us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.353455 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.353466 (+    11us) server_negotiation.cc:408] Connection header received
1211 15:03:09.353499 (+    33us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.353501 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.353540 (+    39us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.353614 (+    74us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.354124 (+   510us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.354808 (+   684us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.355501 (+   693us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.355682 (+   181us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.357543 (+  1861us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.357562 (+    19us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.357564 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.357590 (+    26us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.359198 (+  1608us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.359561 (+   363us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.359564 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.359565 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.359614 (+    49us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.359813 (+   199us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.359816 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.359818 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.360039 (+   221us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.360129 (+    90us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.360392 (+   263us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.360509 (+   117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":96,"threads_started":1}
I20251211 15:03:09.361558 13243 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } has no permanent_uuid. Determining permanent_uuid...
Dec 11 15:03:09 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465389, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.188@KRBTEST.COM for oryx/127.5.160.188@KRBTEST.COM
I20251211 15:03:09.368945 13245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.362067 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.188:35895 (local address 127.0.0.1:53546)
1211 15:03:09.362209 (+   142us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.362221 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.362292 (+    71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.362491 (+   199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.362494 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.362621 (+   127us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:09.362780 (+   159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.362785 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.363499 (+   714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.363502 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.363916 (+   414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.363924 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.364044 (+   120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.364584 (+   540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:09.364599 (+    15us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:09.365831 (+  1232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:09.367679 (+  1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.367683 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.367685 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.367840 (+   155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.368102 (+   262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.368104 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.368105 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.368141 (+    36us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.368507 (+   366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:09.368510 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:09.368593 (+    83us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.368691 (+    98us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.368809 (+   118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20251211 15:03:09.369120 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.362118 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53546 (local address 127.5.160.188:35895)
1211 15:03:09.362226 (+   108us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.362230 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.362256 (+    26us) server_negotiation.cc:408] Connection header received
1211 15:03:09.362349 (+    93us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.362351 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.362388 (+    37us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.362449 (+    61us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.362868 (+   419us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.363377 (+   509us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.364027 (+   650us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.364173 (+   146us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.365971 (+  1798us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.365989 (+    18us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.365992 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.366014 (+    22us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.367564 (+  1550us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.367977 (+   413us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.367980 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.367981 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.368026 (+    45us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.368230 (+   204us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.368233 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.368234 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.368394 (+   160us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.368478 (+    84us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.368781 (+   303us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.368915 (+   134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20251211 15:03:09.372051 13243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: Bootstrap starting.
I20251211 15:03:09.374522 13243 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:09.375341 13243 log.cc:826] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:09.377300 13243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: No bootstrap required, opened a new log
I20251211 15:03:09.380316 13243 raft_consensus.cc:359] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } }
I20251211 15:03:09.380519 13243 raft_consensus.cc:385] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:09.380577 13243 raft_consensus.cc:740] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36fb0f4f5d140f5a34f891811372f74, State: Initialized, Role: FOLLOWER
I20251211 15:03:09.381028 13243 consensus_queue.cc:260] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } }
I20251211 15:03:09.381536 13249 sys_catalog.cc:455] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } } }
I20251211 15:03:09.381652 13249 sys_catalog.cc:458] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [sys.catalog]: This master's current role is: FOLLOWER
I20251211 15:03:09.382170 13243 sys_catalog.cc:565] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [sys.catalog]: configured and running, proceeding with master startup.
W20251211 15:03:09.386686 13260 catalog_manager.cc:1568] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251211 15:03:09.386775 13260 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251211 15:03:09.390807 13097 master_runner.cc:428] Detected that this master b36fb0f4f5d140f5a34f891811372f74 is joining an existing cluster
I20251211 15:03:09.390882 13097 master_runner.cc:432] Initiating AddMaster RPC to add 127.5.160.188:35895
I20251211 15:03:09.410143 13078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.406019 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:47684)
1211 15:03:09.406164 (+   145us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.406181 (+    17us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.406273 (+    92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.406639 (+   366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.406643 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.406673 (+    30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:09.406958 (+   285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.406966 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.408780 (+  1814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.408784 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.409641 (+   857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.409650 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.409775 (+   125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.409850 (+    75us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.409908 (+    58us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.409988 (+    80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"spinlock_wait_cycles":768}
I20251211 15:03:09.411535 13268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.406137 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47684 (local address 127.5.160.190:44329)
1211 15:03:09.406438 (+   301us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.406442 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.406453 (+    11us) server_negotiation.cc:408] Connection header received
1211 15:03:09.406500 (+    47us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.406502 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.406542 (+    40us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.406612 (+    70us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:09.407081 (+   469us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.407913 (+   832us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.409781 (+  1868us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.410229 (+   448us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.410304 (+    75us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.410353 (+    49us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.410454 (+   101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":116,"threads_started":1}
I20251211 15:03:09.416678 13078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.413294 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.189:43525 (local address 127.0.0.1:35810)
1211 15:03:09.413439 (+   145us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.413452 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.413517 (+    65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.413971 (+   454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.413974 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.413996 (+    22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:09.414219 (+   223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.414227 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.415300 (+  1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.415305 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.416281 (+   976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.416291 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.416380 (+    89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.416401 (+    21us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.416439 (+    38us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.416518 (+    79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20251211 15:03:09.416864 13267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.393083 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.188:35895 (local address 127.0.0.1:53548)
1211 15:03:09.393467 (+   384us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.393481 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.393582 (+   101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.393980 (+   398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.393983 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.407268 (+ 13285us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:09.407569 (+   301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.407580 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.408406 (+   826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.408409 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.408912 (+   503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.408922 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.409302 (+   380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.410657 (+  1355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:09.410674 (+    17us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:09.411057 (+   383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:09.413955 (+  2898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.413958 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.413960 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.414152 (+   192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.414720 (+   568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.414723 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.414726 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.414785 (+    59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.416338 (+  1553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:09.416342 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:09.416439 (+    97us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.416541 (+   102us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.416672 (+   131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":120,"threads_started":1}
I20251211 15:03:09.417343 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.393344 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53548 (local address 127.5.160.188:35895)
1211 15:03:09.393439 (+    95us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.393443 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.393557 (+   114us) server_negotiation.cc:408] Connection header received
1211 15:03:09.393664 (+   107us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.393667 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.393700 (+    33us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.393762 (+    62us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.407696 (+ 13934us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.408288 (+   592us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.409023 (+   735us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.409196 (+   173us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.411187 (+  1991us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.411206 (+    19us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.411209 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.411231 (+    22us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.413831 (+  2600us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.414242 (+   411us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.414246 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.414248 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.414298 (+    50us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.414878 (+   580us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.414881 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.414883 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.415091 (+   208us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.415180 (+    89us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.417089 (+  1909us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.417206 (+   117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20251211 15:03:09.417851 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.393052 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47674 (local address 127.5.160.190:44329)
1211 15:03:09.393184 (+   132us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.393189 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.393431 (+   242us) server_negotiation.cc:408] Connection header received
1211 15:03:09.393623 (+   192us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.393627 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.393685 (+    58us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.393762 (+    77us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.410549 (+ 16787us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.411336 (+   787us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.412332 (+   996us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.412503 (+   171us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.414662 (+  2159us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.414678 (+    16us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.414682 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.414707 (+    25us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.416303 (+  1596us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.416721 (+   418us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.416725 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.416727 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.416775 (+    48us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.417043 (+   268us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.417047 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.417049 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.417202 (+   153us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.417268 (+    66us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.417599 (+   331us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.417718 (+   119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20251211 15:03:09.418203 13270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.413427 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35810 (local address 127.5.160.189:43525)
1211 15:03:09.413711 (+   284us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.413715 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.413728 (+    13us) server_negotiation.cc:408] Connection header received
1211 15:03:09.413771 (+    43us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.413775 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.413834 (+    59us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.414323 (+   489us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:09.414420 (+    97us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.415159 (+   739us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.417293 (+  2134us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.417779 (+   486us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.417941 (+   162us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.417997 (+    56us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.418068 (+    71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":97,"threads_started":1}
I20251211 15:03:09.418323 13266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.392975 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:47674)
1211 15:03:09.393346 (+   371us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.393360 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.393505 (+   145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.393790 (+   285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.393794 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.408152 (+ 14358us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:09.408878 (+   726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.408901 (+    23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.411478 (+  2577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.411481 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.412211 (+   730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.412229 (+    18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.412359 (+   130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.413191 (+   832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:09.413208 (+    17us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:09.414526 (+  1318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:09.416415 (+  1889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.416419 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.416421 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.416615 (+   194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.416881 (+   266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.416884 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.416886 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.416949 (+    63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.417331 (+   382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:09.417333 (+     2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:09.417412 (+    79us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.418043 (+   631us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.418173 (+   130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":128,"threads_started":1}
I20251211 15:03:09.420521 13269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.407198 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.189:43525 (local address 127.0.0.1:35796)
1211 15:03:09.407880 (+   682us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.407893 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.408026 (+   133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.408339 (+   313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.408342 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.408543 (+   201us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:09.409126 (+   583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.409133 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.410139 (+  1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.410143 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.411353 (+  1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.411362 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.411808 (+   446us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.412702 (+   894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:09.412721 (+    19us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:09.413576 (+   855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:09.419003 (+  5427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.419006 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.419008 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.419235 (+   227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.419530 (+   295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.419533 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.419536 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.419588 (+    52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.420010 (+   422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:09.420014 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:09.420105 (+    91us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.420208 (+   103us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.420337 (+   129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":99,"threads_started":1}
I20251211 15:03:09.420579 13247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.407579 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35796 (local address 127.5.160.189:43525)
1211 15:03:09.407711 (+   132us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.407715 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.407960 (+   245us) server_negotiation.cc:408] Connection header received
1211 15:03:09.408124 (+   164us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.408127 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.408174 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.408220 (+    46us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.409253 (+  1033us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.409997 (+   744us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.411487 (+  1490us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.411688 (+   201us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.413713 (+  2025us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.413733 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.413736 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.413765 (+    29us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.416199 (+  2434us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.419362 (+  3163us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.419366 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.419368 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.419427 (+    59us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.419679 (+   252us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.419682 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.419684 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.419870 (+   186us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.419943 (+    73us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.420297 (+   354us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.420431 (+   134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Dec 11 15:03:09 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465387, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.190@KRBTEST.COM for oryx/127.5.160.188@KRBTEST.COM
I20251211 15:03:09.431401 13078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.422318 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.188:35895 (local address 127.0.0.1:53550)
1211 15:03:09.422430 (+   112us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.422444 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.422516 (+    72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.423029 (+   513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.423033 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.423242 (+   209us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:09.423486 (+   244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.423494 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.424264 (+   770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.424270 (+     6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.424839 (+   569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.424852 (+    13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.424999 (+   147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.425610 (+   611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:09.425630 (+    20us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:09.427296 (+  1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:09.429664 (+  2368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.429667 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.429669 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.429873 (+   204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.430282 (+   409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.430285 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.430287 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.430347 (+    60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.430773 (+   426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:09.430776 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:09.430879 (+   103us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.431047 (+   168us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.431200 (+   153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20251211 15:03:09.431468 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.422543 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53550 (local address 127.5.160.188:35895)
1211 15:03:09.422651 (+   108us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.422655 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.422668 (+    13us) server_negotiation.cc:408] Connection header received
1211 15:03:09.422742 (+    74us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.422745 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.422799 (+    54us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.422873 (+    74us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.423619 (+   746us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.424120 (+   501us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.424995 (+   875us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.425158 (+   163us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.427444 (+  2286us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.427466 (+    22us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.427469 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.427502 (+    33us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.429526 (+  2024us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.430049 (+   523us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.430053 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.430055 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.430115 (+    60us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.430442 (+   327us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.430446 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.430448 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.430655 (+   207us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.430758 (+   103us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.431121 (+   363us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.431308 (+   187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20251211 15:03:09.432783 12512 catalog_manager.cc:7141] Initiating ChangeConfig request to add master 127.5.160.188:35895: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
  permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74"
  member_type: NON_VOTER
  last_known_addr {
    host: "127.5.160.188"
    port: 35895
  }
  attrs {
    promote: true
  }
}
dest_uuid: "0299041a087e49eeaf7adbe9c2dd0756"
cas_config_opid_index: 5
I20251211 15:03:09.433586 12512 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: NON_VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: true } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } }
I20251211 15:03:09.434651 13083 raft_consensus.cc:2955] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER b36fb0f4f5d140f5a34f891811372f74 (127.5.160.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: NON_VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: true } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } } }
I20251211 15:03:09.435427 13216 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:09.435869 13083 catalog_manager.cc:7145] Successfully completed master ChangeConfig request to add master 127.5.160.188:35895
I20251211 15:03:09.436084 13083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: NON_VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: true } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } } }
I20251211 15:03:09.436178 13083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:09.436368 13097 master.cc:561] Master@127.5.160.188:35895 shutting down...
I20251211 15:03:09.436815 13216 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 1 FOLLOWER]: Refusing update from remote peer 0299041a087e49eeaf7adbe9c2dd0756: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20251211 15:03:09.437505 13082 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:09.439316 13135 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 LEARNER]: Refusing update from remote peer 0299041a087e49eeaf7adbe9c2dd0756: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
W20251211 15:03:09.439900 12500 consensus_peers.cc:597] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 -> Peer b36fb0f4f5d140f5a34f891811372f74 (127.5.160.188:35895): Couldn't send request to peer b36fb0f4f5d140f5a34f891811372f74. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20251211 15:03:09.439904 13082 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: NON_VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20251211 15:03:09.442281 13135 raft_consensus.cc:2955] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER b36fb0f4f5d140f5a34f891811372f74 (127.5.160.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: NON_VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: true } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } } }
I20251211 15:03:09.444252 13272 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: NON_VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: true } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } } }
I20251211 15:03:09.444417 13272 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: This master's current role is: LEARNER
I20251211 15:03:09.444655 13164 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0299041a087e49eeaf7adbe9c2dd0756. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: NON_VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: true } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } } }
I20251211 15:03:09.444748 13164 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: This master's current role is: LEARNER
I20251211 15:03:09.445565 13082 raft_consensus.cc:1064] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756: attempting to promote NON_VOTER d5d5706f9b8549af870a01843f6bc054 to VOTER
I20251211 15:03:09.445843 13097 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:03:09.446142 13097 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:09.446077 13082 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } }
I20251211 15:03:09.446334 13097 tablet_replica.cc:333] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: stopping tablet replica
I20251211 15:03:09.447623 13135 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 LEARNER]: Refusing update from remote peer 0299041a087e49eeaf7adbe9c2dd0756: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20251211 15:03:09.448119 13083 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20251211 15:03:09.448261 12500 consensus_peers.cc:597] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 -> Peer b36fb0f4f5d140f5a34f891811372f74 (127.5.160.188:35895): Couldn't send request to peer b36fb0f4f5d140f5a34f891811372f74. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20251211 15:03:09.450399 13083 raft_consensus.cc:2955] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, d5d5706f9b8549af870a01843f6bc054 (127.5.160.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } } }
I20251211 15:03:09.451599 13135 raft_consensus.cc:2955] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, d5d5706f9b8549af870a01843f6bc054 (127.5.160.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } } }
I20251211 15:03:09.451913 13083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } } }
I20251211 15:03:09.452018 13083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:09.451992 13273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } } }
I20251211 15:03:09.452105 13273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:09.452883 13164 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } } }
I20251211 15:03:09.453006 13164 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: This master's current role is: FOLLOWER
I20251211 15:03:09.456836 13078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.456535 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.188:35895 (local address 127.0.0.1:53566)
1211 15:03:09.456681 (+   146us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.456752 (+    71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.188:35895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20251211 15:03:09.457084 12513 master.cc:679] Network error: unable to get registration information for peer b36fb0f4f5d140f5a34f891811372f74: Client connection negotiation failed: client connection to 127.5.160.188:35895: connect: Connection refused (error 111)
I20251211 15:03:09.461833 13097 master.cc:583] Master@127.5.160.188:35895 shutdown complete.
I20251211 15:03:09.461889 13097 master_runner.cc:305] Clearing existing system tablet
I20251211 15:03:09.462121 13097 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:09.462167 13097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:09.463243 13097 fs_manager.cc:714] Time spent opening directory manager: real 0.001s	user 0.000s	sys 0.002s
I20251211 15:03:09.463990 13275 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:09.464222 13097 fs_report.cc:389] FS layout report
--------------------
wal directory: 
metadata directory: 
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:09.464386 13097 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20251211 15:03:09.464432 13097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/wal
uuid: "b36fb0f4f5d140f5a34f891811372f74"
format_stamp: "Formatted at 2025-12-11 15:03:09 on dist-test-slave-4k3m"
server_key: "6eae7e2c1722a1587fc430abcfa53b61"
server_key_iv: "fe1bf555e9721c171cafad1e3d12b0a7"
server_key_version: "encryptionkey@0"
I20251211 15:03:09.466568 13097 ts_tablet_manager.cc:1916] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:09.469065 13097 ts_tablet_manager.cc:1929] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20251211 15:03:09.469182 13097 log.cc:1199] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20251211 15:03:09.469415 13097 ts_tablet_manager.cc:1950] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: Deleting consensus metadata
I20251211 15:03:09.469570 13097 master_runner.cc:315] Copying system tablet from 127.5.160.190:44329
I20251211 15:03:09.470872 13097 tablet_copy_client.cc:323] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: tablet copy: Beginning tablet copy session from remote peer at address 127.5.160.190:44329
I20251211 15:03:09.477852 13078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.477543 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.188:35895 (local address 127.0.0.1:53580)
1211 15:03:09.477687 (+   144us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.477754 (+    67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.188:35895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20251211 15:03:09.478073 12513 master.cc:679] Network error: unable to get registration information for peer b36fb0f4f5d140f5a34f891811372f74: Client connection negotiation failed: client connection to 127.5.160.188:35895: connect: Connection refused (error 111)
I20251211 15:03:09.479648 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.471648 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47698 (local address 127.5.160.190:44329)
1211 15:03:09.471806 (+   158us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.471812 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.472019 (+   207us) server_negotiation.cc:408] Connection header received
1211 15:03:09.472137 (+   118us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.472141 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.472209 (+    68us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.472313 (+   104us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:09.473255 (+   942us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.474052 (+   797us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.474814 (+   762us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.475031 (+   217us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.476276 (+  1245us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:09.476293 (+    17us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:09.476295 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:09.476318 (+    23us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:09.478131 (+  1813us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.478578 (+   447us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.478582 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.478584 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.478629 (+    45us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:09.478847 (+   218us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:09.478851 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:09.478853 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:09.479073 (+   220us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:09.479165 (+    92us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.479399 (+   234us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.479502 (+   103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20251211 15:03:09.479671 13281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.471537 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:47698)
1211 15:03:09.471922 (+   385us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.471936 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.472050 (+   114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.472365 (+   315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.472368 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.472625 (+   257us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:09.473113 (+   488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.473123 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.474231 (+  1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.474235 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.474690 (+   455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.474701 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.474820 (+   119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.475493 (+   673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:09.475510 (+    17us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:09.476128 (+   618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:09.478283 (+  2155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.478287 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.478290 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.478484 (+   194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.478721 (+   237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:09.478723 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:09.478725 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:09.478771 (+    46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:09.479165 (+   394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:09.479168 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:09.479252 (+    84us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.479340 (+    88us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.479495 (+   155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":88,"threads_started":1}
I20251211 15:03:09.480038 12533 tablet_copy_service.cc:140] P 0299041a087e49eeaf7adbe9c2dd0756: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer b36fb0f4f5d140f5a34f891811372f74 ({username='oryx', principal='oryx/127.5.160.188@KRBTEST.COM'} at 127.0.0.1:47698)
I20251211 15:03:09.480132 12533 tablet_copy_service.cc:161] P 0299041a087e49eeaf7adbe9c2dd0756: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer b36fb0f4f5d140f5a34f891811372f74 at {username='oryx', principal='oryx/127.5.160.188@KRBTEST.COM'} at 127.0.0.1:47698: session id = b36fb0f4f5d140f5a34f891811372f74-00000000000000000000000000000000
I20251211 15:03:09.480880 12533 tablet_copy_source_session.cc:215] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756: Tablet Copy: opened 0 blocks and 1 log segments
I20251211 15:03:09.482138 13097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20251211 15:03:09.484560 13097 tablet_copy_client.cc:806] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: tablet copy: Starting download of 0 data blocks...
I20251211 15:03:09.484741 13097 tablet_copy_client.cc:670] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: tablet copy: Starting download of 1 WAL segments...
I20251211 15:03:09.486394 13097 tablet_copy_client.cc:538] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 15:03:09.488474 12533 tablet_copy_service.cc:342] P 0299041a087e49eeaf7adbe9c2dd0756: Request end of tablet copy session b36fb0f4f5d140f5a34f891811372f74-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.5.160.188@KRBTEST.COM'} at 127.0.0.1:47698
I20251211 15:03:09.488566 12533 tablet_copy_service.cc:434] P 0299041a087e49eeaf7adbe9c2dd0756: ending tablet copy session b36fb0f4f5d140f5a34f891811372f74-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer b36fb0f4f5d140f5a34f891811372f74
W20251211 15:03:09.493429 13097 builtin_ntp.cc:688] coult not shutdown socket: Network error: shutdown error: Transport endpoint is not connected (error 107)
I20251211 15:03:09.496182 13097 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:09.498242 13283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:09.498201 13282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:09.498330 13097 server_base.cc:1047] running on GCE node
W20251211 15:03:09.498203 13285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:09.498605 13097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:09.498914 13097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:09.500072 13097 hybrid_clock.cc:648] HybridClock initialized: now 1765465389500065 us; error 26 us; skew 500 ppm
Dec 11 15:03:09 dist-test-slave-4k3m krb5kdc[12465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465389, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:09.501641 13097 init.cc:377] Logged in from keytab as oryx/127.5.160.188@KRBTEST.COM (short username oryx)
I20251211 15:03:09.502148 13097 webserver.cc:492] Webserver started at http://127.5.160.188:33289/ using document root <none> and password file <none>
I20251211 15:03:09.502312 13097 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:09.502346 13097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:09.503419 13097 fs_manager.cc:714] Time spent opening directory manager: real 0.001s	user 0.000s	sys 0.001s
I20251211 15:03:09.504302 13292 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:09.504577 13097 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20251211 15:03:09.504643 13097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/wal
uuid: "b36fb0f4f5d140f5a34f891811372f74"
format_stamp: "Formatted at 2025-12-11 15:03:09 on dist-test-slave-4k3m"
server_key: "6eae7e2c1722a1587fc430abcfa53b61"
server_key_iv: "fe1bf555e9721c171cafad1e3d12b0a7"
server_key_version: "encryptionkey@0"
I20251211 15:03:09.504719 13097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:09.511493 13097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:09.514066 13097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:09.514212 13078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.513917 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.188:35895 (local address 127.0.0.1:53584)
1211 15:03:09.514072 (+   155us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.514117 (+    45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.188:35895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20251211 15:03:09.514416 12513 master.cc:679] Network error: unable to get registration information for peer b36fb0f4f5d140f5a34f891811372f74: Client connection negotiation failed: client connection to 127.5.160.188:35895: connect: Connection refused (error 111)
I20251211 15:03:09.518851 13097 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.188:35895
I20251211 15:03:09.519177 13344 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.188:35895 every 8 connection(s)
I20251211 15:03:09.519572 13097 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/master-2/data/info.pb
I20251211 15:03:09.521241 13345 sys_catalog.cc:263] Verifying existing consensus state
I20251211 15:03:09.522316 13345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: Bootstrap starting.
I20251211 15:03:09.531401 13345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 15:03:09.531687 13345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: Bootstrap complete.
I20251211 15:03:09.532241 13345 raft_consensus.cc:359] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } }
I20251211 15:03:09.532351 13345 raft_consensus.cc:740] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b36fb0f4f5d140f5a34f891811372f74, State: Initialized, Role: LEARNER
I20251211 15:03:09.532435 13345 consensus_queue.cc:260] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } }
I20251211 15:03:09.532755 13348 sys_catalog.cc:455] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } } }
I20251211 15:03:09.532864 13348 sys_catalog.cc:458] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [sys.catalog]: This master's current role is: LEARNER
I20251211 15:03:09.532894 13345 sys_catalog.cc:565] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:03:09.535815 13359 catalog_manager.cc:1269] Loaded cluster ID: ef5f6ba1b13548aaa59b85d5085990c0
I20251211 15:03:09.535885 13359 catalog_manager.cc:1562] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: loading cluster ID for follower catalog manager: success
I20251211 15:03:09.538113 13359 catalog_manager.cc:1584] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: acquiring CA information for follower catalog manager: success
I20251211 15:03:09.539673 13359 catalog_manager.cc:1612] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251211 15:03:09.540673 12842 heartbeater.cc:499] Master 127.5.160.190:44329 was elected leader, sending a full tablet report...
I20251211 15:03:09.584777 13078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.582051 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.188:35895 (local address 127.0.0.1:53594)
1211 15:03:09.582190 (+   139us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:09.582203 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:09.582279 (+    76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:09.582640 (+   361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:09.582643 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:09.582656 (+    13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:09.582831 (+   175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.582836 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.583812 (+   976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.583815 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:09.584424 (+   609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:09.584433 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.584538 (+   105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.584556 (+    18us) client_negotiation.cc:769] Sending connection context
1211 15:03:09.584590 (+    34us) client_negotiation.cc:240] Negotiation successful
1211 15:03:09.584645 (+    55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20251211 15:03:09.585227 13360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:09.582190 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53594 (local address 127.5.160.188:35895)
1211 15:03:09.582430 (+   240us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:09.582433 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:09.582446 (+    13us) server_negotiation.cc:408] Connection header received
1211 15:03:09.582489 (+    43us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:09.582492 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:09.582541 (+    49us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:09.582626 (+    85us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:09.582951 (+   325us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.583680 (+   729us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:09.584526 (+   846us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:09.584848 (+   322us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:09.585005 (+   157us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:09.585058 (+    53us) server_negotiation.cc:300] Negotiation successful
1211 15:03:09.585118 (+    60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":81,"threads_started":1}
I20251211 15:03:09.779186 12978 heartbeater.cc:499] Master 127.5.160.190:44329 was elected leader, sending a full tablet report...
I20251211 15:03:09.930127 13319 raft_consensus.cc:1217] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7]   Dedup: 1.7->[]
I20251211 15:03:09.930588 13348 sys_catalog.cc:455] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0299041a087e49eeaf7adbe9c2dd0756. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } } }
I20251211 15:03:09.930729 13348 sys_catalog.cc:458] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [sys.catalog]: This master's current role is: LEARNER
I20251211 15:03:10.447242 13082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: NON_VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: true } } }
I20251211 15:03:10.447423 13082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:10.448277 13362 raft_consensus.cc:1064] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756: attempting to promote NON_VOTER b36fb0f4f5d140f5a34f891811372f74 to VOTER
I20251211 15:03:10.448648 13362 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } }
I20251211 15:03:10.449834 13319 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 1 LEARNER]: Refusing update from remote peer 0299041a087e49eeaf7adbe9c2dd0756: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20251211 15:03:10.449836 13135 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 FOLLOWER]: Refusing update from remote peer 0299041a087e49eeaf7adbe9c2dd0756: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20251211 15:03:10.450276 13082 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20251211 15:03:10.450508 13362 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20251211 15:03:10.452149 13082 raft_consensus.cc:2955] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b36fb0f4f5d140f5a34f891811372f74 (127.5.160.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } } }
I20251211 15:03:10.452574 13135 raft_consensus.cc:2955] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b36fb0f4f5d140f5a34f891811372f74 (127.5.160.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } } }
I20251211 15:03:10.453754 13361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } } }
I20251211 15:03:10.453855 13361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:10.454015 13361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } } }
I20251211 15:03:10.454095 13361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:10.453800 13319 raft_consensus.cc:2955] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b36fb0f4f5d140f5a34f891811372f74 (127.5.160.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } } }
I20251211 15:03:10.454216 13361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } } }
I20251211 15:03:10.454290 13361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:10.455134 13365 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } } }
I20251211 15:03:10.455256 13365 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: This master's current role is: FOLLOWER
I20251211 15:03:10.455531 13367 sys_catalog.cc:455] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0299041a087e49eeaf7adbe9c2dd0756" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } } }
I20251211 15:03:10.455669 13367 sys_catalog.cc:458] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [sys.catalog]: This master's current role is: FOLLOWER
I20251211 15:03:10.503798 13369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.497031 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35814 (local address 127.5.160.189:43525)
1211 15:03:10.497304 (+   273us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:10.497307 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:10.497321 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:03:10.497400 (+    79us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:10.497402 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:10.497443 (+    41us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:10.497515 (+    72us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:10.498335 (+   820us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.498908 (+   573us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.499527 (+   619us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.499663 (+   136us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.500744 (+  1081us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:10.500763 (+    19us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:10.500766 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:10.500792 (+    26us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:10.502360 (+  1568us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.502794 (+   434us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.502798 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.502800 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.502853 (+    53us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.503080 (+   227us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.503087 (+     7us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.503089 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.503246 (+   157us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:10.503345 (+    99us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:10.503513 (+   168us) server_negotiation.cc:300] Negotiation successful
1211 15:03:10.503624 (+   111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":118,"threads_started":1}
I20251211 15:03:10.507154 13370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.504593 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:47704)
1211 15:03:10.504878 (+   285us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:10.504891 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:10.504972 (+    81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:10.505188 (+   216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:10.505191 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:10.505208 (+    17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:10.505388 (+   180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.505393 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.506145 (+   752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.506149 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:10.506740 (+   591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.506748 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.506886 (+   138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.506906 (+    20us) client_negotiation.cc:769] Sending connection context
1211 15:03:10.506977 (+    71us) client_negotiation.cc:240] Negotiation successful
1211 15:03:10.507036 (+    59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":93,"threads_started":1}
I20251211 15:03:10.507496 13371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.504732 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47704 (local address 127.5.160.190:44329)
1211 15:03:10.504992 (+   260us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:10.504995 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:10.505007 (+    12us) server_negotiation.cc:408] Connection header received
1211 15:03:10.505050 (+    43us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:10.505052 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:10.505096 (+    44us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:10.505170 (+    74us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:10.505490 (+   320us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.506024 (+   534us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.506838 (+   814us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.507239 (+   401us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.507282 (+    43us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:10.507337 (+    55us) server_negotiation.cc:300] Negotiation successful
1211 15:03:10.507391 (+    54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":105,"threads_started":1}
I20251211 15:03:10.511355 13370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.508943 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.189:43525 (local address 127.0.0.1:35822)
1211 15:03:10.509072 (+   129us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:10.509087 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:10.509162 (+    75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:10.509351 (+   189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:10.509353 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:10.509376 (+    23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:10.509525 (+   149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.509530 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.510358 (+   828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.510363 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:10.511007 (+   644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.511016 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.511149 (+   133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.511169 (+    20us) client_negotiation.cc:769] Sending connection context
1211 15:03:10.511210 (+    41us) client_negotiation.cc:240] Negotiation successful
1211 15:03:10.511256 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"spinlock_wait_cycles":768}
I20251211 15:03:10.511686 13369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.509068 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35822 (local address 127.5.160.189:43525)
1211 15:03:10.509180 (+   112us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:10.509184 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:10.509196 (+    12us) server_negotiation.cc:408] Connection header received
1211 15:03:10.509238 (+    42us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:10.509240 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:10.509275 (+    35us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:10.509340 (+    65us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:10.509632 (+   292us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.510232 (+   600us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.511134 (+   902us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.511465 (+   331us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.511503 (+    38us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:10.511547 (+    44us) server_negotiation.cc:300] Negotiation successful
1211 15:03:10.511600 (+    53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45,"spinlock_wait_cycles":896}
I20251211 15:03:10.515264 13370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.512801 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.188:35895 (local address 127.0.0.1:53602)
1211 15:03:10.512916 (+   115us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:10.512928 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:10.512987 (+    59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:10.513427 (+   440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:10.513430 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:10.513448 (+    18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:10.513591 (+   143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.513596 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.514331 (+   735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.514334 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:10.514876 (+   542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.514883 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.515017 (+   134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.515036 (+    19us) client_negotiation.cc:769] Sending connection context
1211 15:03:10.515085 (+    49us) client_negotiation.cc:240] Negotiation successful
1211 15:03:10.515144 (+    59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20251211 15:03:10.515671 13372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.512948 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53602 (local address 127.5.160.188:35895)
1211 15:03:10.513222 (+   274us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:10.513228 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:10.513242 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:03:10.513288 (+    46us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:10.513292 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:10.513336 (+    44us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:10.513408 (+    72us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:10.513697 (+   289us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.514228 (+   531us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.515007 (+   779us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.515458 (+   451us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.515491 (+    33us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:10.515535 (+    44us) server_negotiation.cc:300] Negotiation successful
1211 15:03:10.515578 (+    43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":84,"threads_started":1}
I20251211 15:03:10.525133 13372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.517656 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53606 (local address 127.5.160.188:35895)
1211 15:03:10.517784 (+   128us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:10.517787 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:10.517800 (+    13us) server_negotiation.cc:408] Connection header received
1211 15:03:10.517861 (+    61us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:10.517864 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:10.517902 (+    38us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:10.517965 (+    63us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:10.518698 (+   733us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.519388 (+   690us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.520193 (+   805us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.520383 (+   190us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.521879 (+  1496us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:10.521901 (+    22us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:10.521904 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:10.521939 (+    35us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:10.523617 (+  1678us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.524087 (+   470us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.524090 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.524091 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.524136 (+    45us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.524378 (+   242us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.524381 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.524382 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.524542 (+   160us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:10.524658 (+   116us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:10.524839 (+   181us) server_negotiation.cc:300] Negotiation successful
1211 15:03:10.524964 (+   125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20251211 15:03:10.528355 13373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.525938 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:47710)
1211 15:03:10.526193 (+   255us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:10.526205 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:10.526274 (+    69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:10.526487 (+   213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:10.526489 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:10.526500 (+    11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:10.526684 (+   184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.526689 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.527447 (+   758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.527451 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:10.528039 (+   588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.528046 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.528153 (+   107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.528170 (+    17us) client_negotiation.cc:769] Sending connection context
1211 15:03:10.528205 (+    35us) client_negotiation.cc:240] Negotiation successful
1211 15:03:10.528252 (+    47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":98,"threads_started":1}
I20251211 15:03:10.528694 13371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.526067 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47710 (local address 127.5.160.190:44329)
1211 15:03:10.526225 (+   158us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:10.526230 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:10.526245 (+    15us) server_negotiation.cc:408] Connection header received
1211 15:03:10.526357 (+   112us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:10.526360 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:10.526408 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:10.526483 (+    75us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:10.526779 (+   296us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.527344 (+   565us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.528137 (+   793us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.528454 (+   317us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.528492 (+    38us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:10.528541 (+    49us) server_negotiation.cc:300] Negotiation successful
1211 15:03:10.528603 (+    62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20251211 15:03:10.532060 13373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.529747 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.189:43525 (local address 127.0.0.1:35834)
1211 15:03:10.529864 (+   117us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:10.529876 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:10.529935 (+    59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:10.530212 (+   277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:10.530215 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:10.530236 (+    21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:10.530379 (+   143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.530384 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.531152 (+   768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.531155 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:10.531768 (+   613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.531776 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.531868 (+    92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.531884 (+    16us) client_negotiation.cc:769] Sending connection context
1211 15:03:10.531917 (+    33us) client_negotiation.cc:240] Negotiation successful
1211 15:03:10.531960 (+    43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20251211 15:03:10.532449 13369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.529853 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35834 (local address 127.5.160.189:43525)
1211 15:03:10.529996 (+   143us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:10.530000 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:10.530011 (+    11us) server_negotiation.cc:408] Connection header received
1211 15:03:10.530057 (+    46us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:10.530059 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:10.530099 (+    40us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:10.530161 (+    62us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:10.530495 (+   334us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.531049 (+   554us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.531868 (+   819us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.532221 (+   353us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.532260 (+    39us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:10.532309 (+    49us) server_negotiation.cc:300] Negotiation successful
1211 15:03:10.532363 (+    54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20251211 15:03:10.535698 13373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.533586 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.188:35895 (local address 127.0.0.1:53622)
1211 15:03:10.533695 (+   109us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:10.533708 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:10.533770 (+    62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:10.533989 (+   219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:10.533991 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:10.534003 (+    12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:10.534139 (+   136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.534143 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.534794 (+   651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.534797 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:10.535411 (+   614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.535420 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.535508 (+    88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.535523 (+    15us) client_negotiation.cc:769] Sending connection context
1211 15:03:10.535555 (+    32us) client_negotiation.cc:240] Negotiation successful
1211 15:03:10.535598 (+    43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20251211 15:03:10.536156 13372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.533622 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53622 (local address 127.5.160.188:35895)
1211 15:03:10.533723 (+   101us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:10.533726 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:10.533740 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:03:10.533880 (+   140us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:10.533883 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:10.533920 (+    37us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:10.533978 (+    58us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:10.534255 (+   277us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.534721 (+   466us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.535527 (+   806us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.535962 (+   435us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.535990 (+    28us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:10.536033 (+    43us) server_negotiation.cc:300] Negotiation successful
1211 15:03:10.536072 (+    39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39,"spinlock_wait_cycles":3712}
I20251211 15:03:10.537487  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 12577
I20251211 15:03:10.542788  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:33625
--local_ip_for_outbound_sockets=127.5.160.129
--tserver_master_addrs=127.5.160.190:44329
--webserver_port=40651
--webserver_interface=127.5.160.129
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.5.160.190:44329,127.5.160.189:43525
--tserver_master_addrs=127.5.160.190:44329,127.5.160.189:43525,127.5.160.188:35895 with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:10.650816 13374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:10.651129 13374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:10.651204 13374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:10.654558 13374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:10.654631 13374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:10.654716 13374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:03:10.659150 13374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:33625
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=40651
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:44329,127.5.160.189:43525,127.5.160.188:35895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:10.660218 13374 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:10.661079 13374 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:10.667776 13380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:10.667965 13374 server_base.cc:1047] running on GCE node
W20251211 15:03:10.667776 13379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:10.667778 13382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:10.668468 13374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:10.669006 13374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:10.670154 13374 hybrid_clock.cc:648] HybridClock initialized: now 1765465390670140 us; error 32 us; skew 500 ppm
Dec 11 15:03:10 dist-test-slave-4k3m krb5kdc[12465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465390, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:10.672775 13374 init.cc:377] Logged in from keytab as oryx/127.5.160.129@KRBTEST.COM (short username oryx)
I20251211 15:03:10.673781 13374 webserver.cc:492] Webserver started at http://127.5.160.129:40651/ using document root <none> and password file <none>
I20251211 15:03:10.674351 13374 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:10.674409 13374 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:10.678013 13374 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:10.680064 13389 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:10.681111 13374 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:10.681236 13374 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "d7461d2a9bca462b968a0041aeffac81"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "a0548d5923681cf08de1efc54958d8f8"
server_key_iv: "ef90b6cd3d8688c620909110ae78bb24"
server_key_version: "encryptionkey@0"
I20251211 15:03:10.681645 13374 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:10.704496 13374 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:10.707636 13374 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:10.707800 13374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:10.708343 13374 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:10.709313 13374 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:10.709363 13374 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:10.709404 13374 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:10.709419 13374 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:10.719107 13374 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:33625
I20251211 15:03:10.719137 13502 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:33625 every 8 connection(s)
I20251211 15:03:10.720140 13374 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:03:10.728886  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 13374
Dec 11 15:03:10 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465390, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.189@KRBTEST.COM
I20251211 15:03:10.729084  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 12713
Dec 11 15:03:10 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465390, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.188@KRBTEST.COM
Dec 11 15:03:10 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465390, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
I20251211 15:03:10.734740 13372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.721899 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:35941 (local address 127.5.160.188:35895)
1211 15:03:10.722039 (+   140us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:10.722044 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:10.722781 (+   737us) server_negotiation.cc:408] Connection header received
1211 15:03:10.723910 (+  1129us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:10.723914 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:10.723971 (+    57us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:10.724043 (+    72us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:10.725495 (+  1452us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.726036 (+   541us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.726845 (+   809us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.727066 (+   221us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.730849 (+  3783us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:10.730869 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:10.730871 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:10.730898 (+    27us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:10.732488 (+  1590us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.733154 (+   666us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.733159 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.733161 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.733217 (+    56us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.733494 (+   277us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.733498 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.733500 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.733660 (+   160us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:10.733747 (+    87us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:10.734438 (+   691us) server_negotiation.cc:300] Negotiation successful
1211 15:03:10.734574 (+   136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20251211 15:03:10.734975 13371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.723392 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:36255 (local address 127.5.160.190:44329)
1211 15:03:10.723552 (+   160us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:10.723557 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:10.723635 (+    78us) server_negotiation.cc:408] Connection header received
1211 15:03:10.724163 (+   528us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:10.724166 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:10.724216 (+    50us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:10.724288 (+    72us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:10.725488 (+  1200us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.726264 (+   776us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.727792 (+  1528us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.728030 (+   238us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.730863 (+  2833us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:10.730887 (+    24us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:10.730891 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:10.730924 (+    33us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:10.732671 (+  1747us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.733332 (+   661us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.733335 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.733337 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.733389 (+    52us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.733994 (+   605us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.733997 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.734000 (+     3us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.734190 (+   190us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:10.734300 (+   110us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:10.734579 (+   279us) server_negotiation.cc:300] Negotiation successful
1211 15:03:10.734712 (+   133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20251211 15:03:10.735900 13507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.722208 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.188:35895 (local address 127.5.160.129:35941)
1211 15:03:10.722640 (+   432us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:10.722685 (+    45us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:10.723718 (+  1033us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:10.724198 (+   480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:10.724206 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:10.724742 (+   536us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:10.725347 (+   605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.725355 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.726190 (+   835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.726193 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:10.726715 (+   522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.726723 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.726974 (+   251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.727750 (+   776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:10.727767 (+    17us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:10.730658 (+  2891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:10.732611 (+  1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:10.732617 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:10.732631 (+    14us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:10.733048 (+   417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:10.733307 (+   259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:10.733309 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:10.733311 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:10.733398 (+    87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:10.733762 (+   364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:10.733828 (+    66us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:10.734162 (+   334us) client_negotiation.cc:769] Sending connection context
1211 15:03:10.734384 (+   222us) client_negotiation.cc:240] Negotiation successful
1211 15:03:10.734687 (+   303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"spinlock_wait_cycles":57344,"thread_start_us":105,"threads_started":1}
I20251211 15:03:10.735982 13509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.723206 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.129:36255)
1211 15:03:10.723569 (+   363us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:10.723580 (+    11us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:10.723735 (+   155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:10.724318 (+   583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:10.724321 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:10.725140 (+   819us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:10.725389 (+   249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.725395 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.727281 (+  1886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.727284 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:10.727637 (+   353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.727644 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.727776 (+   132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.728286 (+   510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:10.728301 (+    15us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:10.730658 (+  2357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:10.732790 (+  2132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:10.732793 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:10.732795 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:10.733048 (+   253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:10.733828 (+   780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:10.733831 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:10.733832 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:10.733904 (+    72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:10.734301 (+   397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:10.734305 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:10.734398 (+    93us) client_negotiation.cc:769] Sending connection context
1211 15:03:10.735157 (+   759us) client_negotiation.cc:240] Negotiation successful
1211 15:03:10.735303 (+   146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"spinlock_wait_cycles":8576,"thread_start_us":79,"threads_started":1}
I20251211 15:03:10.736811  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:40275
--local_ip_for_outbound_sockets=127.5.160.130
--tserver_master_addrs=127.5.160.190:44329
--webserver_port=34825
--webserver_interface=127.5.160.130
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.5.160.190:44329,127.5.160.189:43525
--tserver_master_addrs=127.5.160.190:44329,127.5.160.189:43525,127.5.160.188:35895 with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20251211 15:03:10.737414 13504 heartbeater.cc:344] Connected to a master server at 127.5.160.190:44329
I20251211 15:03:10.737416 13503 heartbeater.cc:344] Connected to a master server at 127.5.160.188:35895
I20251211 15:03:10.737689 13504 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:10.738405 13504 heartbeater.cc:507] Master 127.5.160.190:44329 requested a full tablet report, sending...
I20251211 15:03:10.737690 13503 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:10.739214 13503 heartbeater.cc:507] Master 127.5.160.188:35895 requested a full tablet report, sending...
I20251211 15:03:10.739707 12513 ts_manager.cc:194] Re-registered known tserver with Master: d7461d2a9bca462b968a0041aeffac81 (127.5.160.129:33625)
I20251211 15:03:10.740295 13309 ts_manager.cc:194] Registered new tserver with Master: d7461d2a9bca462b968a0041aeffac81 (127.5.160.129:33625)
I20251211 15:03:10.740424 13508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.722208 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.189:43525 (local address 127.5.160.129:57559)
1211 15:03:10.722640 (+   432us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:10.722684 (+    44us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:10.723717 (+  1033us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:10.724198 (+   481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:10.724207 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:10.724729 (+   522us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:10.725307 (+   578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.725318 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.726338 (+  1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.726341 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:10.726831 (+   490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.726838 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.726974 (+   136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.727687 (+   713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:10.727719 (+    32us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:10.736294 (+  8575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:10.738919 (+  2625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:10.738923 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:10.738948 (+    25us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:10.739150 (+   202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:10.739437 (+   287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:10.739440 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:10.739442 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:10.739496 (+    54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:10.739913 (+   417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:10.739916 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:10.740000 (+    84us) client_negotiation.cc:769] Sending connection context
1211 15:03:10.740087 (+    87us) client_negotiation.cc:240] Negotiation successful
1211 15:03:10.740226 (+   139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":21,"spinlock_wait_cycles":45440,"thread_start_us":100,"threads_started":1}
I20251211 15:03:10.740443 12513 master_service.cc:502] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:36255
I20251211 15:03:10.740940 13369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.722057 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:57559 (local address 127.5.160.189:43525)
1211 15:03:10.722165 (+   108us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:10.722170 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:10.722779 (+   609us) server_negotiation.cc:408] Connection header received
1211 15:03:10.723919 (+  1140us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:10.723923 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:10.723971 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:10.724036 (+    65us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:10.725455 (+  1419us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.726238 (+   783us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.726976 (+   738us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.727147 (+   171us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.736463 (+  9316us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:10.736486 (+    23us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:10.736489 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:10.736521 (+    32us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:10.738806 (+  2285us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.739270 (+   464us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.739273 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.739275 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.739333 (+    58us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.739583 (+   250us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.739586 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.739588 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.739764 (+   176us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:10.739868 (+   104us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:10.740648 (+   780us) server_negotiation.cc:300] Negotiation successful
1211 15:03:10.740779 (+   131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20251211 15:03:10.742611 13505 heartbeater.cc:344] Connected to a master server at 127.5.160.189:43525
I20251211 15:03:10.742694 13505 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:10.742871 13505 heartbeater.cc:507] Master 127.5.160.189:43525 requested a full tablet report, sending...
I20251211 15:03:10.744029 13125 ts_manager.cc:194] Registered new tserver with Master: d7461d2a9bca462b968a0041aeffac81 (127.5.160.129:33625)
W20251211 15:03:10.849553 13510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:10.849818 13510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:10.849885 13510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:10.853346 13510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:10.853420 13510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:10.853503 13510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:03:10.857909 13510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:40275
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=34825
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:44329,127.5.160.189:43525,127.5.160.188:35895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:10.859001 13510 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:10.859817 13510 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:10.867147 13515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:10.867166 13518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:10.867156 13516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:10.867210 13510 server_base.cc:1047] running on GCE node
I20251211 15:03:10.867743 13510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:10.868287 13510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:10.869432 13510 hybrid_clock.cc:648] HybridClock initialized: now 1765465390869402 us; error 47 us; skew 500 ppm
Dec 11 15:03:10 dist-test-slave-4k3m krb5kdc[12465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465390, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:10.872057 13510 init.cc:377] Logged in from keytab as oryx/127.5.160.130@KRBTEST.COM (short username oryx)
I20251211 15:03:10.873121 13510 webserver.cc:492] Webserver started at http://127.5.160.130:34825/ using document root <none> and password file <none>
I20251211 15:03:10.873716 13510 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:10.873827 13510 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:10.878151 13510 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.001s	sys 0.001s
I20251211 15:03:10.880237 13525 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:10.881331 13510 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:03:10.881443 13510 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "08e8b567337e43e685d75b1cf1e5c8ab"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "57a5961c1d6aaf1ce28b709b16004cee"
server_key_iv: "04931aa7d980247e356d10bcacc62730"
server_key_version: "encryptionkey@0"
I20251211 15:03:10.881855 13510 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:10.897974 13510 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:10.901254 13510 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:10.901453 13510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:10.902032 13510 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:10.903061 13510 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:10.903113 13510 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:10.903168 13510 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:10.903192 13510 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:10.912801 13510 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:40275
I20251211 15:03:10.912825 13638 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:40275 every 8 connection(s)
I20251211 15:03:10.913873 13510 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:03:10.923512  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 13510
I20251211 15:03:10.923702  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 12849
Dec 11 15:03:10 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465390, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.189@KRBTEST.COM
Dec 11 15:03:10 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465390, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
Dec 11 15:03:10 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465390, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.188@KRBTEST.COM
I20251211 15:03:10.930269 13369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.917411 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:33701 (local address 127.5.160.189:43525)
1211 15:03:10.917523 (+   112us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:10.917527 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:10.917705 (+   178us) server_negotiation.cc:408] Connection header received
1211 15:03:10.917965 (+   260us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:10.917968 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:10.918016 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:10.918084 (+    68us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:10.920753 (+  2669us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.921253 (+   500us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.921980 (+   727us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.922159 (+   179us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.925810 (+  3651us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:10.925836 (+    26us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:10.925839 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:10.925875 (+    36us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:10.927727 (+  1852us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.928429 (+   702us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.928434 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.928436 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.928490 (+    54us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.928904 (+   414us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.928915 (+    11us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.928917 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.929131 (+   214us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:10.929228 (+    97us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:10.929909 (+   681us) server_negotiation.cc:300] Negotiation successful
1211 15:03:10.930077 (+   168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20251211 15:03:10.931185 13645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.917207 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.189:43525 (local address 127.5.160.130:33701)
1211 15:03:10.917617 (+   410us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:10.917629 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:10.917746 (+   117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:10.918288 (+   542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:10.918300 (+    12us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:10.918892 (+   592us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:10.919688 (+   796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.919698 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.921377 (+  1679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.921381 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:10.921830 (+   449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.921839 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.922283 (+   444us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.922739 (+   456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:10.922756 (+    17us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:10.925622 (+  2866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:10.927830 (+  2208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:10.927833 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:10.927838 (+     5us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:10.928313 (+   475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:10.928621 (+   308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:10.928624 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:10.928626 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:10.928775 (+   149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:10.929294 (+   519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:10.929303 (+     9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:10.929595 (+   292us) client_negotiation.cc:769] Sending connection context
1211 15:03:10.929833 (+   238us) client_negotiation.cc:240] Negotiation successful
1211 15:03:10.930281 (+   448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"mutex_wait_us":130,"spinlock_wait_cycles":39552,"thread_start_us":82,"threads_started":1}
I20251211 15:03:10.931200 13643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.916138 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.188:35895 (local address 127.5.160.130:54205)
1211 15:03:10.916933 (+   795us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:10.916946 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:10.917729 (+   783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:10.918290 (+   561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:10.918299 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:10.919139 (+   840us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:10.919640 (+   501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.919654 (+    14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.920775 (+  1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.920780 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:10.921451 (+   671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.921462 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.921720 (+   258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.922592 (+   872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:10.922636 (+    44us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:10.925620 (+  2984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:10.927815 (+  2195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:10.927822 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:10.927838 (+    16us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:10.928313 (+   475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:10.928808 (+   495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:10.928812 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:10.928814 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:10.928870 (+    56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:10.929295 (+   425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:10.929303 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:10.929590 (+   287us) client_negotiation.cc:769] Sending connection context
1211 15:03:10.929881 (+   291us) client_negotiation.cc:240] Negotiation successful
1211 15:03:10.930177 (+   296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"spinlock_wait_cycles":18944,"thread_start_us":140,"threads_started":1}
I20251211 15:03:10.931608 13372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.916029 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:54205 (local address 127.5.160.188:35895)
1211 15:03:10.916151 (+   122us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:10.916155 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:10.917017 (+   862us) server_negotiation.cc:408] Connection header received
1211 15:03:10.918070 (+  1053us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:10.918074 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:10.918132 (+    58us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:10.918206 (+    74us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:10.919800 (+  1594us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.920595 (+   795us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.921578 (+   983us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.921772 (+   194us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.925785 (+  4013us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:10.925805 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:10.925807 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:10.925837 (+    30us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:10.927660 (+  1823us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.928620 (+   960us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.928624 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.928626 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.928683 (+    57us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.928961 (+   278us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.928966 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.928967 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.929168 (+   201us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:10.929274 (+   106us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:10.931002 (+  1728us) server_negotiation.cc:300] Negotiation successful
1211 15:03:10.931174 (+   172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20251211 15:03:10.932541 13641 heartbeater.cc:344] Connected to a master server at 127.5.160.189:43525
I20251211 15:03:10.932873 13641 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:10.932947 13639 heartbeater.cc:344] Connected to a master server at 127.5.160.188:35895
I20251211 15:03:10.933043 13639 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:10.933554 13639 heartbeater.cc:507] Master 127.5.160.188:35895 requested a full tablet report, sending...
I20251211 15:03:10.933555 13641 heartbeater.cc:507] Master 127.5.160.189:43525 requested a full tablet report, sending...
I20251211 15:03:10.934403  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:43053
--local_ip_for_outbound_sockets=127.5.160.131
--tserver_master_addrs=127.5.160.190:44329
--webserver_port=40425
--webserver_interface=127.5.160.131
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:42521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.5.160.190:44329,127.5.160.189:43525
--tserver_master_addrs=127.5.160.190:44329,127.5.160.189:43525,127.5.160.188:35895 with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20251211 15:03:10.934821 13125 ts_manager.cc:194] Registered new tserver with Master: 08e8b567337e43e685d75b1cf1e5c8ab (127.5.160.130:40275)
I20251211 15:03:10.934832 13309 ts_manager.cc:194] Registered new tserver with Master: 08e8b567337e43e685d75b1cf1e5c8ab (127.5.160.130:40275)
I20251211 15:03:10.937711 13371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.915797 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:51649 (local address 127.5.160.190:44329)
1211 15:03:10.915940 (+   143us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:10.915945 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:10.916763 (+   818us) server_negotiation.cc:408] Connection header received
1211 15:03:10.918402 (+  1639us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:10.918407 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:10.918470 (+    63us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:10.918555 (+    85us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:10.919866 (+  1311us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.920617 (+   751us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.921907 (+  1290us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.922105 (+   198us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.925448 (+  3343us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:10.925476 (+    28us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:10.925479 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:10.925518 (+    39us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:10.933520 (+  8002us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.936219 (+  2699us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.936224 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.936227 (+     3us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.936306 (+    79us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:10.936676 (+   370us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:10.936680 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:10.936681 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:10.936901 (+   220us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:10.937000 (+    99us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:10.937465 (+   465us) server_negotiation.cc:300] Negotiation successful
1211 15:03:10.937591 (+   126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20251211 15:03:10.937711 13644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:10.916138 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.130:51649)
1211 15:03:10.916619 (+   481us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:10.916656 (+    37us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:10.918285 (+  1629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:10.918592 (+   307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:10.918595 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:10.918892 (+   297us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:10.919688 (+   796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.919698 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.920775 (+  1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:10.920780 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:10.921451 (+   671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:10.921462 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:10.921720 (+   258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:10.922988 (+  1268us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:10.923004 (+    16us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:10.925211 (+  2207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:10.935873 (+ 10662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:10.935877 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:10.935878 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:10.936076 (+   198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:10.936449 (+   373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:10.936453 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:10.936454 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:10.936526 (+    72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:10.937041 (+   515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:10.937045 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:10.937218 (+   173us) client_negotiation.cc:769] Sending connection context
1211 15:03:10.937335 (+   117us) client_negotiation.cc:240] Negotiation successful
1211 15:03:10.937499 (+   164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"spinlock_wait_cycles":173440,"thread_start_us":140,"threads_started":1}
I20251211 15:03:10.938421 13640 heartbeater.cc:344] Connected to a master server at 127.5.160.190:44329
I20251211 15:03:10.938535 13640 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:10.938766 13640 heartbeater.cc:507] Master 127.5.160.190:44329 requested a full tablet report, sending...
I20251211 15:03:10.939527 12513 ts_manager.cc:194] Re-registered known tserver with Master: 08e8b567337e43e685d75b1cf1e5c8ab (127.5.160.130:40275)
I20251211 15:03:10.940169 12513 master_service.cc:502] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.160.130@KRBTEST.COM'} at 127.5.160.130:51649
W20251211 15:03:11.049015 13646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:11.049273 13646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:11.049330 13646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:11.052788 13646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:11.052863 13646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:11.052953 13646 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:03:11.057426 13646 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:42521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:43053
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=40425
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:44329,127.5.160.189:43525,127.5.160.188:35895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:11.058526 13646 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:11.059425 13646 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:11.066562 13654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:11.066545 13652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:11.066553 13651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:11.066668 13646 server_base.cc:1047] running on GCE node
I20251211 15:03:11.067317 13646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:11.067895 13646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:11.069072 13646 hybrid_clock.cc:648] HybridClock initialized: now 1765465391069048 us; error 37 us; skew 500 ppm
Dec 11 15:03:11 dist-test-slave-4k3m krb5kdc[12465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465391, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:11.071877 13646 init.cc:377] Logged in from keytab as oryx/127.5.160.131@KRBTEST.COM (short username oryx)
I20251211 15:03:11.073024 13646 webserver.cc:492] Webserver started at http://127.5.160.131:40425/ using document root <none> and password file <none>
I20251211 15:03:11.073558 13646 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:11.073617 13646 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:11.077319 13646 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.001s
I20251211 15:03:11.079349 13661 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:11.080511 13646 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:11.080617 13646 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "68b2237f121640b3a6b46e60e5274e0d"
format_stamp: "Formatted at 2025-12-11 15:03:08 on dist-test-slave-4k3m"
server_key: "fe723f13dfa0d11dfe6beb330dd81115"
server_key_iv: "eb36902b321dba9a806fc03e80035bf0"
server_key_version: "encryptionkey@0"
I20251211 15:03:11.081041 13646 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:11.098038 13646 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:11.101325 13646 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:11.101516 13646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:11.102082 13646 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:11.103050 13646 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:11.103101 13646 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:11.103142 13646 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:11.103176 13646 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:11.112582 13646 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:43053
I20251211 15:03:11.112604 13774 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:43053 every 8 connection(s)
I20251211 15:03:11.113611 13646 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
I20251211 15:03:11.121665  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 13646
Dec 11 15:03:11 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465391, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.188@KRBTEST.COM
Dec 11 15:03:11 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465391, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
Dec 11 15:03:11 dist-test-slave-4k3m krb5kdc[12465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465391, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.189@KRBTEST.COM
I20251211 15:03:11.129128 13371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.115612 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:42709 (local address 127.5.160.190:44329)
1211 15:03:11.115768 (+   156us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:11.115773 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:11.116417 (+   644us) server_negotiation.cc:408] Connection header received
1211 15:03:11.117618 (+  1201us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:11.117622 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:11.117670 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:11.117735 (+    65us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:11.119290 (+  1555us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.119793 (+   503us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.120497 (+   704us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.120677 (+   180us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.124200 (+  3523us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:11.124221 (+    21us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:11.124225 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:11.124258 (+    33us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:11.126462 (+  2204us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.127163 (+   701us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.127167 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.127169 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.127224 (+    55us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.127599 (+   375us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.127602 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.127604 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.127794 (+   190us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:11.127893 (+    99us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:11.128844 (+   951us) server_negotiation.cc:300] Negotiation successful
1211 15:03:11.128975 (+   131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20251211 15:03:11.129755 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.116803 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.189:43525 (local address 127.5.160.131:48391)
1211 15:03:11.117072 (+   269us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:11.117086 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:11.117318 (+   232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:11.117932 (+   614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:11.117936 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:11.118428 (+   492us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:11.119163 (+   735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.119173 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.120818 (+  1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.120821 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:11.121302 (+   481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.121312 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.121742 (+   430us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.122233 (+   491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:11.122248 (+    15us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:11.124384 (+  2136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:11.127328 (+  2944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:11.127331 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:11.127333 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:11.127518 (+   185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:11.127755 (+   237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:11.127758 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:11.127760 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:11.127806 (+    46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:11.128184 (+   378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:11.128188 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:11.128315 (+   127us) client_negotiation.cc:769] Sending connection context
1211 15:03:11.128553 (+   238us) client_negotiation.cc:240] Negotiation successful
1211 15:03:11.128856 (+   303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"spinlock_wait_cycles":7680,"thread_start_us":82,"threads_started":1}
I20251211 15:03:11.130653 13779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.115753 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.131:42709)
1211 15:03:11.116274 (+   521us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:11.116319 (+    45us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:11.117306 (+   987us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:11.117814 (+   508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:11.117817 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:11.118428 (+   611us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:11.119163 (+   735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.119173 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.119906 (+   733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.119910 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:11.120382 (+   472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.120390 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.120612 (+   222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.121251 (+   639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:11.121290 (+    39us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:11.124077 (+  2787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:11.126594 (+  2517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:11.126602 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:11.126618 (+    16us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:11.127039 (+   421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:11.127324 (+   285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:11.127327 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:11.127330 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:11.127475 (+   145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:11.127945 (+   470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:11.127953 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:11.128498 (+   545us) client_negotiation.cc:769] Sending connection context
1211 15:03:11.128594 (+    96us) client_negotiation.cc:240] Negotiation successful
1211 15:03:11.130485 (+  1891us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":1651,"spinlock_wait_cycles":36352,"thread_start_us":138,"threads_started":1}
I20251211 15:03:11.131469 13369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.117140 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:48391 (local address 127.5.160.189:43525)
1211 15:03:11.117254 (+   114us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:11.117258 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:11.117270 (+    12us) server_negotiation.cc:408] Connection header received
1211 15:03:11.117768 (+   498us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:11.117771 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:11.117823 (+    52us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:11.117903 (+    80us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:11.120001 (+  2098us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.120693 (+   692us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.121438 (+   745us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.121627 (+   189us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.124501 (+  2874us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:11.124520 (+    19us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:11.124523 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:11.124553 (+    30us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:11.127227 (+  2674us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.127616 (+   389us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.127619 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.127620 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.127666 (+    46us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.127895 (+   229us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.127898 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.127900 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.128056 (+   156us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:11.128145 (+    89us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:11.131181 (+  3036us) server_negotiation.cc:300] Negotiation successful
1211 15:03:11.131319 (+   138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20251211 15:03:11.131889 13776 heartbeater.cc:344] Connected to a master server at 127.5.160.190:44329
I20251211 15:03:11.132187 13776 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:11.132879 13776 heartbeater.cc:507] Master 127.5.160.190:44329 requested a full tablet report, sending...
I20251211 15:03:11.133164 13786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.123678 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47726 (local address 127.5.160.190:44329)
1211 15:03:11.124909 (+  1231us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:11.124914 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:11.125250 (+   336us) server_negotiation.cc:408] Connection header received
1211 15:03:11.125296 (+    46us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:11.125299 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:11.125356 (+    57us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:11.125436 (+    80us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:11.126308 (+   872us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.127116 (+   808us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.128229 (+  1113us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.128413 (+   184us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.129439 (+  1026us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:11.129456 (+    17us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:11.129459 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:11.129482 (+    23us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:11.131328 (+  1846us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.131750 (+   422us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.131753 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.131755 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.131802 (+    47us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.132057 (+   255us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.132060 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.132062 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.132249 (+   187us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:11.132359 (+   110us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:11.132883 (+   524us) server_negotiation.cc:300] Negotiation successful
1211 15:03:11.133005 (+   122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1139,"thread_start_us":71,"threads_started":1}
I20251211 15:03:11.133481 13372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.115465 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:55305 (local address 127.5.160.188:35895)
1211 15:03:11.115766 (+   301us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:11.115771 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:11.116417 (+   646us) server_negotiation.cc:408] Connection header received
1211 15:03:11.117496 (+  1079us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:11.117501 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:11.117556 (+    55us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:11.117630 (+    74us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:11.119289 (+  1659us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.119783 (+   494us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.120584 (+   801us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.120765 (+   181us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.123692 (+  2927us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:11.123714 (+    22us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:11.123718 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:11.123750 (+    32us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:11.126334 (+  2584us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.132318 (+  5984us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.132322 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.132324 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.132393 (+    69us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.132665 (+   272us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.132668 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.132670 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.132849 (+   179us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:11.132932 (+    83us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:11.133260 (+   328us) server_negotiation.cc:300] Negotiation successful
1211 15:03:11.133376 (+   116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206}
I20251211 15:03:11.133980 13780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.115753 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.188:35895 (local address 127.5.160.131:55305)
1211 15:03:11.116274 (+   521us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:11.116318 (+    44us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:11.117316 (+   998us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:11.117804 (+   488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:11.117816 (+    12us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:11.118651 (+   835us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:11.119143 (+   492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.119158 (+    15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.119905 (+   747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.119908 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:11.120454 (+   546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.120463 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.120883 (+   420us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.121441 (+   558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:11.121456 (+    15us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:11.123488 (+  2032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:11.131963 (+  8475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:11.131966 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:11.131969 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:11.132186 (+   217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:11.132515 (+   329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:11.132518 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:11.132520 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:11.132573 (+    53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:11.132988 (+   415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:11.132991 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:11.133071 (+    80us) client_negotiation.cc:769] Sending connection context
1211 15:03:11.133669 (+   598us) client_negotiation.cc:240] Negotiation successful
1211 15:03:11.133812 (+   143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"mutex_wait_us":52,"spinlock_wait_cycles":96768,"thread_start_us":142,"threads_started":1}
I20251211 15:03:11.134523 13777 heartbeater.cc:344] Connected to a master server at 127.5.160.189:43525
I20251211 15:03:11.134653 13777 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:11.134878 13777 heartbeater.cc:507] Master 127.5.160.189:43525 requested a full tablet report, sending...
I20251211 15:03:11.135087 13775 heartbeater.cc:344] Connected to a master server at 127.5.160.188:35895
I20251211 15:03:11.135181 13775 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:11.135370 13775 heartbeater.cc:507] Master 127.5.160.188:35895 requested a full tablet report, sending...
I20251211 15:03:11.135859 13125 ts_manager.cc:194] Registered new tserver with Master: 68b2237f121640b3a6b46e60e5274e0d (127.5.160.131:43053)
I20251211 15:03:11.135964 12513 ts_manager.cc:194] Re-registered known tserver with Master: 68b2237f121640b3a6b46e60e5274e0d (127.5.160.131:43053)
I20251211 15:03:11.136229 13309 ts_manager.cc:194] Registered new tserver with Master: 68b2237f121640b3a6b46e60e5274e0d (127.5.160.131:43053)
I20251211 15:03:11.136616 12513 master_service.cc:502] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.160.131@KRBTEST.COM'} at 127.5.160.131:42709
I20251211 15:03:11.139259 13789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.124421 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35838 (local address 127.5.160.189:43525)
1211 15:03:11.124685 (+   264us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:11.124690 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:11.126558 (+  1868us) server_negotiation.cc:408] Connection header received
1211 15:03:11.126602 (+    44us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:11.126605 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:11.126655 (+    50us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:11.126728 (+    73us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:11.127763 (+  1035us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.128496 (+   733us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.129658 (+  1162us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.129871 (+   213us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.130700 (+   829us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:11.130720 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:11.130724 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:11.130752 (+    28us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:11.132584 (+  1832us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.133010 (+   426us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.133014 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.133016 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.133076 (+    60us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.133304 (+   228us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.133307 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.133309 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.133468 (+   159us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:11.133671 (+   203us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:11.137334 (+  3663us) server_negotiation.cc:300] Negotiation successful
1211 15:03:11.139042 (+  1708us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":77,"threads_started":1}
I20251211 15:03:11.137691 12513 catalog_manager.cc:2257] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47726:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20251211 15:03:11.140674 12513 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:03:11.142372 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.123992 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53634 (local address 127.5.160.188:35895)
1211 15:03:11.125453 (+  1461us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:11.125458 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:11.134791 (+  9333us) server_negotiation.cc:408] Connection header received
1211 15:03:11.135042 (+   251us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:11.135046 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:11.135123 (+    77us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:11.135214 (+    91us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:11.136197 (+   983us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.136919 (+   722us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.137794 (+   875us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.137984 (+   190us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.139072 (+  1088us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:11.139091 (+    19us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:11.139094 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:11.139121 (+    27us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:11.140861 (+  1740us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.141327 (+   466us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.141330 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.141331 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.141376 (+    45us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.141628 (+   252us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.141631 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.141632 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.141797 (+   165us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:11.141940 (+   143us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:11.142128 (+   188us) server_negotiation.cc:300] Negotiation successful
1211 15:03:11.142232 (+   104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1375,"thread_start_us":82,"threads_started":1}
I20251211 15:03:11.156972 13800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.152985 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:40275 (local address 127.0.0.1:35966)
1211 15:03:11.153670 (+   685us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:11.153685 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:11.153842 (+   157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:11.154539 (+   697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:11.154542 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:11.154557 (+    15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:11.154755 (+   198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.154760 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.155882 (+  1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.155886 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:11.156568 (+   682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.156577 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.156685 (+   108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.156708 (+    23us) client_negotiation.cc:769] Sending connection context
1211 15:03:11.156757 (+    49us) client_negotiation.cc:240] Negotiation successful
1211 15:03:11.156820 (+    63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":128,"threads_started":1}
I20251211 15:03:11.157682 13801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.153155 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35966 (local address 127.5.160.130:40275)
1211 15:03:11.153455 (+   300us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:11.153462 (+     7us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:11.153768 (+   306us) server_negotiation.cc:408] Connection header received
1211 15:03:11.154029 (+   261us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:11.154036 (+     7us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:11.154231 (+   195us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:11.154358 (+   127us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:11.154871 (+   513us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.155669 (+   798us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.156695 (+  1026us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.157247 (+   552us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.157374 (+   127us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:11.157441 (+    67us) server_negotiation.cc:300] Negotiation successful
1211 15:03:11.157542 (+   101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":102,"threads_started":1}
I20251211 15:03:11.157730 13802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.153363 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:43053 (local address 127.0.0.1:46616)
1211 15:03:11.153641 (+   278us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:11.153656 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:11.153747 (+    91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:11.154795 (+  1048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:11.154798 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:11.154819 (+    21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:11.155202 (+   383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.155211 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.156539 (+  1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.156542 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:11.157401 (+   859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.157411 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.157511 (+   100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.157526 (+    15us) client_negotiation.cc:769] Sending connection context
1211 15:03:11.157569 (+    43us) client_negotiation.cc:240] Negotiation successful
1211 15:03:11.157622 (+    53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":25,"thread_start_us":113,"threads_started":1}
I20251211 15:03:11.159554 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.153490 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46616 (local address 127.5.160.131:43053)
1211 15:03:11.153783 (+   293us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:11.153789 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:11.153811 (+    22us) server_negotiation.cc:408] Connection header received
1211 15:03:11.154025 (+   214us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:11.154033 (+     8us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:11.154236 (+   203us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:11.154380 (+   144us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:11.155324 (+   944us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.156218 (+   894us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.158543 (+  2325us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.159138 (+   595us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.159252 (+   114us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:11.159320 (+    68us) server_negotiation.cc:300] Negotiation successful
1211 15:03:11.159419 (+    99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":84,"threads_started":1}
I20251211 15:03:11.160713 13805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.154458 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53826 (local address 127.5.160.129:33625)
1211 15:03:11.154821 (+   363us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:11.154827 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:11.154848 (+    21us) server_negotiation.cc:408] Connection header received
1211 15:03:11.154977 (+   129us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:11.154982 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:11.155183 (+   201us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:11.156448 (+  1265us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:11.156811 (+   363us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.157807 (+   996us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.159865 (+  2058us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.160389 (+   524us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.160489 (+   100us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:11.160544 (+    55us) server_negotiation.cc:300] Negotiation successful
1211 15:03:11.160608 (+    64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":163,"threads_started":1}
I20251211 15:03:11.160604 13573 tablet_service.cc:1505] Processing CreateTablet for tablet 80b3a18d236f428c9df0239be37f56ff (DEFAULT_TABLE table=test-table [id=a3f604b8237f46998a476b57b7218a0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:11.161022 13804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.154167 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:33625 (local address 127.0.0.1:53826)
1211 15:03:11.154399 (+   232us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:11.154412 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:11.154484 (+    72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:11.156434 (+  1950us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:11.156438 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:11.156458 (+    20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:11.156676 (+   218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.156683 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.157927 (+  1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.157931 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:11.158775 (+   844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.158785 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.158901 (+   116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.158918 (+    17us) client_negotiation.cc:769] Sending connection context
1211 15:03:11.160860 (+  1942us) client_negotiation.cc:240] Negotiation successful
1211 15:03:11.160929 (+    69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":99,"threads_started":1}
I20251211 15:03:11.161633 13573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b3a18d236f428c9df0239be37f56ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:11.162322 13709 tablet_service.cc:1505] Processing CreateTablet for tablet 80b3a18d236f428c9df0239be37f56ff (DEFAULT_TABLE table=test-table [id=a3f604b8237f46998a476b57b7218a0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:11.163242 13709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b3a18d236f428c9df0239be37f56ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:11.163373 13437 tablet_service.cc:1505] Processing CreateTablet for tablet 80b3a18d236f428c9df0239be37f56ff (DEFAULT_TABLE table=test-table [id=a3f604b8237f46998a476b57b7218a0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:11.164170 13437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b3a18d236f428c9df0239be37f56ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:11.169204 13806 tablet_bootstrap.cc:492] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab: Bootstrap starting.
I20251211 15:03:11.170469 13807 tablet_bootstrap.cc:492] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81: Bootstrap starting.
I20251211 15:03:11.171249 13808 tablet_bootstrap.cc:492] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d: Bootstrap starting.
I20251211 15:03:11.171664 13806 tablet_bootstrap.cc:654] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:11.172736 13806 log.cc:826] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:11.172824 13807 tablet_bootstrap.cc:654] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:11.173103 13808 tablet_bootstrap.cc:654] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:11.173599 13807 log.cc:826] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:11.173780 13808 log.cc:826] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:11.174762 13806 tablet_bootstrap.cc:492] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab: No bootstrap required, opened a new log
I20251211 15:03:11.175391 13808 tablet_bootstrap.cc:492] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d: No bootstrap required, opened a new log
I20251211 15:03:11.175391 13807 tablet_bootstrap.cc:492] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81: No bootstrap required, opened a new log
I20251211 15:03:11.175577 13808 ts_tablet_manager.cc:1403] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d: Time spent bootstrapping tablet: real 0.004s	user 0.004s	sys 0.000s
I20251211 15:03:11.175577 13807 ts_tablet_manager.cc:1403] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20251211 15:03:11.175709 13806 ts_tablet_manager.cc:1403] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab: Time spent bootstrapping tablet: real 0.007s	user 0.005s	sys 0.000s
I20251211 15:03:11.178318 13806 raft_consensus.cc:359] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } } peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } }
I20251211 15:03:11.178521 13806 raft_consensus.cc:385] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:11.178573 13806 raft_consensus.cc:740] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e8b567337e43e685d75b1cf1e5c8ab, State: Initialized, Role: FOLLOWER
I20251211 15:03:11.178648 13808 raft_consensus.cc:359] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } } peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } }
I20251211 15:03:11.178648 13807 raft_consensus.cc:359] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } } peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } }
I20251211 15:03:11.178857 13808 raft_consensus.cc:385] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:11.178857 13807 raft_consensus.cc:385] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:11.178920 13808 raft_consensus.cc:740] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68b2237f121640b3a6b46e60e5274e0d, State: Initialized, Role: FOLLOWER
I20251211 15:03:11.178947 13807 raft_consensus.cc:740] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7461d2a9bca462b968a0041aeffac81, State: Initialized, Role: FOLLOWER
I20251211 15:03:11.179052 13806 consensus_queue.cc:260] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } } peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } }
I20251211 15:03:11.179370 13808 consensus_queue.cc:260] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } } peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } }
I20251211 15:03:11.179370 13807 consensus_queue.cc:260] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } } peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } }
I20251211 15:03:11.180123 13806 ts_tablet_manager.cc:1434] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20251211 15:03:11.180172 13807 ts_tablet_manager.cc:1434] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20251211 15:03:11.180181 13808 ts_tablet_manager.cc:1434] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
I20251211 15:03:11.180791 13640 heartbeater.cc:499] Master 127.5.160.190:44329 was elected leader, sending a full tablet report...
I20251211 15:03:11.181267 13776 heartbeater.cc:499] Master 127.5.160.190:44329 was elected leader, sending a full tablet report...
I20251211 15:03:11.181582 13504 heartbeater.cc:499] Master 127.5.160.190:44329 was elected leader, sending a full tablet report...
W20251211 15:03:11.222081 13506 tablet.cc:2378] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251211 15:03:11.364939 13778 tablet.cc:2378] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251211 15:03:11.415337 13642 tablet.cc:2378] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 15:03:11.427752 13813 raft_consensus.cc:493] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:03:11.427971 13813 raft_consensus.cc:515] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } } peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } }
I20251211 15:03:11.429091 13813 leader_election.cc:290] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08e8b567337e43e685d75b1cf1e5c8ab (127.5.160.130:40275), 68b2237f121640b3a6b46e60e5274e0d (127.5.160.131:43053)
I20251211 15:03:11.433064 13816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.429366 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:40275 (local address 127.5.160.129:35385)
1211 15:03:11.429753 (+   387us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:11.429769 (+    16us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:11.429931 (+   162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:11.430207 (+   276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:11.430210 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:11.430243 (+    33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:11.430518 (+   275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.430527 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.431617 (+  1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.431622 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:11.432581 (+   959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.432593 (+    12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.432726 (+   133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.432750 (+    24us) client_negotiation.cc:769] Sending connection context
1211 15:03:11.432801 (+    51us) client_negotiation.cc:240] Negotiation successful
1211 15:03:11.432879 (+    78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"spinlock_wait_cycles":12416,"thread_start_us":92,"threads_started":1}
I20251211 15:03:11.433064 13815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.429366 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:43053 (local address 127.5.160.129:39019)
1211 15:03:11.429777 (+   411us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:11.429788 (+    11us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:11.429900 (+   112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:11.430207 (+   307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:11.430210 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:11.430236 (+    26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:11.430518 (+   282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.430527 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.431617 (+  1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.431622 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:11.432582 (+   960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:11.432593 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.432727 (+   134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.432750 (+    23us) client_negotiation.cc:769] Sending connection context
1211 15:03:11.432801 (+    51us) client_negotiation.cc:240] Negotiation successful
1211 15:03:11.432875 (+    74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":27,"spinlock_wait_cycles":3456,"thread_start_us":79,"threads_started":1}
I20251211 15:03:11.433599 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.429527 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:39019 (local address 127.5.160.131:43053)
1211 15:03:11.429747 (+   220us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:11.429763 (+    16us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:11.429849 (+    86us) server_negotiation.cc:408] Connection header received
1211 15:03:11.430036 (+   187us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:11.430040 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:11.430102 (+    62us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:11.430182 (+    80us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:11.430634 (+   452us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.431463 (+   829us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.432750 (+  1287us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.433298 (+   548us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.433353 (+    55us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:11.433412 (+    59us) server_negotiation.cc:300] Negotiation successful
1211 15:03:11.433475 (+    63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20251211 15:03:11.433599 13801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.429456 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:35385 (local address 127.5.160.130:40275)
1211 15:03:11.429599 (+   143us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:11.429604 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:11.429925 (+   321us) server_negotiation.cc:408] Connection header received
1211 15:03:11.430036 (+   111us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:11.430040 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:11.430103 (+    63us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:11.430191 (+    88us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:11.430634 (+   443us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.431463 (+   829us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.432751 (+  1288us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.433313 (+   562us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.433360 (+    47us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:11.433412 (+    52us) server_negotiation.cc:300] Negotiation successful
1211 15:03:11.433475 (+    63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20251211 15:03:11.434298 13729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "80b3a18d236f428c9df0239be37f56ff" candidate_uuid: "d7461d2a9bca462b968a0041aeffac81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68b2237f121640b3a6b46e60e5274e0d" is_pre_election: true
I20251211 15:03:11.434309 13593 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "80b3a18d236f428c9df0239be37f56ff" candidate_uuid: "d7461d2a9bca462b968a0041aeffac81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" is_pre_election: true
I20251211 15:03:11.434561 13593 raft_consensus.cc:2468] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7461d2a9bca462b968a0041aeffac81 in term 0.
I20251211 15:03:11.434564 13729 raft_consensus.cc:2468] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7461d2a9bca462b968a0041aeffac81 in term 0.
I20251211 15:03:11.435077 13391 leader_election.cc:304] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e8b567337e43e685d75b1cf1e5c8ab, d7461d2a9bca462b968a0041aeffac81; no voters: 
I20251211 15:03:11.435343 13813 raft_consensus.cc:2804] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:03:11.435524 13813 raft_consensus.cc:493] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:03:11.435580 13813 raft_consensus.cc:3060] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:11.436589 13813 raft_consensus.cc:515] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } } peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } }
I20251211 15:03:11.436997 13813 leader_election.cc:290] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [CANDIDATE]: Term 1 election: Requested vote from peers 08e8b567337e43e685d75b1cf1e5c8ab (127.5.160.130:40275), 68b2237f121640b3a6b46e60e5274e0d (127.5.160.131:43053)
I20251211 15:03:11.437422 13729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "80b3a18d236f428c9df0239be37f56ff" candidate_uuid: "d7461d2a9bca462b968a0041aeffac81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68b2237f121640b3a6b46e60e5274e0d"
I20251211 15:03:11.437430 13593 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "80b3a18d236f428c9df0239be37f56ff" candidate_uuid: "d7461d2a9bca462b968a0041aeffac81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e8b567337e43e685d75b1cf1e5c8ab"
I20251211 15:03:11.437568 13729 raft_consensus.cc:3060] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:11.437695 13593 raft_consensus.cc:3060] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:11.438656 13729 raft_consensus.cc:2468] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7461d2a9bca462b968a0041aeffac81 in term 1.
I20251211 15:03:11.438657 13593 raft_consensus.cc:2468] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7461d2a9bca462b968a0041aeffac81 in term 1.
I20251211 15:03:11.439035 13392 leader_election.cc:304] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68b2237f121640b3a6b46e60e5274e0d, d7461d2a9bca462b968a0041aeffac81; no voters: 
I20251211 15:03:11.439232 13813 raft_consensus.cc:2804] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:11.439394 13813 raft_consensus.cc:697] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [term 1 LEADER]: Becoming Leader. State: Replica: d7461d2a9bca462b968a0041aeffac81, State: Running, Role: LEADER
I20251211 15:03:11.439718 13813 consensus_queue.cc:237] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } } peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } }
I20251211 15:03:11.443120 12512 catalog_manager.cc:5654] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7461d2a9bca462b968a0041aeffac81 (127.5.160.129). New cstate: current_term: 1 leader_uuid: "d7461d2a9bca462b968a0041aeffac81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } health_report { overall_health: HEALTHY } } }
I20251211 15:03:11.524712 13805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.521533 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53840 (local address 127.5.160.129:33625)
1211 15:03:11.521686 (+   153us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:11.521691 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:11.521704 (+    13us) server_negotiation.cc:408] Connection header received
1211 15:03:11.521785 (+    81us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:11.521787 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:11.521842 (+    55us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:11.521925 (+    83us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:03:11.522318 (+   393us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.522895 (+   577us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.523564 (+   669us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.523748 (+   184us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.523849 (+   101us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:03:11.524333 (+   484us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:03:11.524439 (+   106us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:11.524518 (+    79us) server_negotiation.cc:300] Negotiation successful
1211 15:03:11.524579 (+    61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20251211 15:03:11.530629 13729 raft_consensus.cc:1275] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d [term 1 FOLLOWER]: Refusing update from remote peer d7461d2a9bca462b968a0041aeffac81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:03:11.530630 13593 raft_consensus.cc:1275] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab [term 1 FOLLOWER]: Refusing update from remote peer d7461d2a9bca462b968a0041aeffac81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:03:11.531313 13817 consensus_queue.cc:1048] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:11.531474 13813 consensus_queue.cc:1048] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:11.541492 13821 mvcc.cc:204] Tried to move back new op lower bound from 7231346243702845440 to 7231346243340054528. Current Snapshot: MvccSnapshot[applied={T|T < 7231346243702845440}]
I20251211 15:03:11.548323 12511 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47726:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:03:11.548496 12511 catalog_manager.cc:2755] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47726:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:03:11.553653 12511 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 0299041a087e49eeaf7adbe9c2dd0756: Sending DeleteTablet for 3 replicas of tablet 80b3a18d236f428c9df0239be37f56ff
I20251211 15:03:11.554412 13573 tablet_service.cc:1552] Processing DeleteTablet for tablet 80b3a18d236f428c9df0239be37f56ff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:11 UTC) from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:35966
I20251211 15:03:11.554905 13829 tablet_replica.cc:333] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab: stopping tablet replica
I20251211 15:03:11.554842 13437 tablet_service.cc:1552] Processing DeleteTablet for tablet 80b3a18d236f428c9df0239be37f56ff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:11 UTC) from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:53826
I20251211 15:03:11.554898 13709 tablet_service.cc:1552] Processing DeleteTablet for tablet 80b3a18d236f428c9df0239be37f56ff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:11 UTC) from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:46616
I20251211 15:03:11.555220 13829 raft_consensus.cc:2243] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:03:11.555428 13830 tablet_replica.cc:333] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81: stopping tablet replica
I20251211 15:03:11.555591 13829 raft_consensus.cc:2272] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:11.555649 13830 raft_consensus.cc:2243] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [term 1 LEADER]: Raft consensus shutting down.
I20251211 15:03:11.555997 13830 raft_consensus.cc:2272] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:11.557231 13829 ts_tablet_manager.cc:1916] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:11.557237 13830 ts_tablet_manager.cc:1916] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:11.558490  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 12481
I20251211 15:03:11.559190 13831 tablet_replica.cc:333] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d: stopping tablet replica
I20251211 15:03:11.559475 13831 raft_consensus.cc:2243] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:03:11.559788 13831 raft_consensus.cc:2272] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:11.561153 13829 ts_tablet_manager.cc:1929] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:03:11.561152 13830 ts_tablet_manager.cc:1929] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:03:11.561244 13829 log.cc:1199] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-1/wal/wals/80b3a18d236f428c9df0239be37f56ff
I20251211 15:03:11.561244 13830 log.cc:1199] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-0/wal/wals/80b3a18d236f428c9df0239be37f56ff
I20251211 15:03:11.561561 13829 ts_tablet_manager.cc:1950] T 80b3a18d236f428c9df0239be37f56ff P 08e8b567337e43e685d75b1cf1e5c8ab: Deleting consensus metadata
I20251211 15:03:11.561573 13830 ts_tablet_manager.cc:1950] T 80b3a18d236f428c9df0239be37f56ff P d7461d2a9bca462b968a0041aeffac81: Deleting consensus metadata
I20251211 15:03:11.563835 13831 ts_tablet_manager.cc:1916] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:11.565765 13831 ts_tablet_manager.cc:1929] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:03:11.565855 13831 log.cc:1199] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/wal/wals/80b3a18d236f428c9df0239be37f56ff
I20251211 15:03:11.566354 13831 ts_tablet_manager.cc:1950] T 80b3a18d236f428c9df0239be37f56ff P 68b2237f121640b3a6b46e60e5274e0d: Deleting consensus metadata
W20251211 15:03:11.567673 13665 connection.cc:537] server connection from 127.0.0.1:46616 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251211 15:03:11.567673 13390 connection.cc:537] server connection from 127.0.0.1:53826 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251211 15:03:11.567974 13528 connection.cc:537] server connection from 127.0.0.1:35966 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251211 15:03:11.579697 13789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.570798 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35846 (local address 127.5.160.189:43525)
1211 15:03:11.570920 (+   122us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:11.570959 (+    39us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:11.571162 (+   203us) server_negotiation.cc:408] Connection header received
1211 15:03:11.571571 (+   409us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:11.571575 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:11.571627 (+    52us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:11.571699 (+    72us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:11.572452 (+   753us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.572938 (+   486us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.574110 (+  1172us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.574599 (+   489us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.575547 (+   948us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:11.575568 (+    21us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:11.575572 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:11.575602 (+    30us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:11.577774 (+  2172us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.578222 (+   448us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.578226 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.578228 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.578280 (+    52us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.578493 (+   213us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.578496 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.578498 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.578689 (+   191us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:11.578806 (+   117us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:11.579391 (+   585us) server_negotiation.cc:300] Negotiation successful
1211 15:03:11.579521 (+   130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20251211 15:03:11.580533 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:11.570536 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53642 (local address 127.5.160.188:35895)
1211 15:03:11.570689 (+   153us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:11.570694 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:11.571029 (+   335us) server_negotiation.cc:408] Connection header received
1211 15:03:11.571296 (+   267us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:11.571299 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:11.571360 (+    61us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:11.571451 (+    91us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:11.572380 (+   929us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.573204 (+   824us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:11.574105 (+   901us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:11.574313 (+   208us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:11.576278 (+  1965us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:11.576299 (+    21us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:11.576303 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:11.576331 (+    28us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:11.578056 (+  1725us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.578474 (+   418us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.578479 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.578481 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.578542 (+    61us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:11.578760 (+   218us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:11.578764 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:11.578765 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:11.579088 (+   323us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:11.579230 (+   142us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:11.580248 (+  1018us) server_negotiation.cc:300] Negotiation successful
1211 15:03:11.580379 (+   131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20251211 15:03:12.544358 13839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:12.543867 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.130:37905)
1211 15:03:12.544167 (+   300us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:12.544244 (+    77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":88,"threads_started":1}
W20251211 15:03:12.544680 13640 heartbeater.cc:646] Failed to heartbeat to 127.5.160.190:44329 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
I20251211 15:03:12.545307 13840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:12.544851 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.131:46873)
1211 15:03:12.545135 (+   284us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:12.545211 (+    76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":68,"threads_started":1}
W20251211 15:03:12.545645 13776 heartbeater.cc:646] Failed to heartbeat to 127.5.160.190:44329 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
I20251211 15:03:12.546651 13841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:12.546304 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.129:55111)
1211 15:03:12.546512 (+   208us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:12.546573 (+    61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":62,"threads_started":1}
W20251211 15:03:12.546906 13504 heartbeater.cc:646] Failed to heartbeat to 127.5.160.190:44329 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
I20251211 15:03:13.054396 13842 raft_consensus.cc:493] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0299041a087e49eeaf7adbe9c2dd0756)
I20251211 15:03:13.054606 13842 raft_consensus.cc:515] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } }
I20251211 15:03:13.054641 13843 raft_consensus.cc:493] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0299041a087e49eeaf7adbe9c2dd0756)
I20251211 15:03:13.054874 13843 raft_consensus.cc:515] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } }
I20251211 15:03:13.055688 13842 leader_election.cc:290] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0299041a087e49eeaf7adbe9c2dd0756 (127.5.160.190:44329), b36fb0f4f5d140f5a34f891811372f74 (127.5.160.188:35895)
I20251211 15:03:13.055825 13843 leader_election.cc:290] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0299041a087e49eeaf7adbe9c2dd0756 (127.5.160.190:44329), d5d5706f9b8549af870a01843f6bc054 (127.5.160.189:43525)
I20251211 15:03:13.056216 13319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d5d5706f9b8549af870a01843f6bc054" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b36fb0f4f5d140f5a34f891811372f74" is_pre_election: true
I20251211 15:03:13.056324 13844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:13.055856 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:48172)
1211 15:03:13.056112 (+   256us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:13.056198 (+    86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":59,"threads_started":1}
I20251211 15:03:13.056398 13319 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5d5706f9b8549af870a01843f6bc054 in term 1.
W20251211 15:03:13.056475 13110 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
I20251211 15:03:13.056712 13845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:13.056182 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:48186)
1211 15:03:13.056562 (+   380us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:13.056623 (+    61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":57,"threads_started":1}
I20251211 15:03:13.056708 13135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b36fb0f4f5d140f5a34f891811372f74" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d5d5706f9b8549af870a01843f6bc054" is_pre_election: true
I20251211 15:03:13.056788 13112 leader_election.cc:304] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36fb0f4f5d140f5a34f891811372f74, d5d5706f9b8549af870a01843f6bc054; no voters: 
W20251211 15:03:13.056835 13294 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
I20251211 15:03:13.056895 13135 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b36fb0f4f5d140f5a34f891811372f74 in term 1.
I20251211 15:03:13.057004 13842 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251211 15:03:13.057065 13842 raft_consensus.cc:493] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0299041a087e49eeaf7adbe9c2dd0756)
I20251211 15:03:13.057112 13842 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 1 FOLLOWER]: Advancing to term 2
I20251211 15:03:13.057431 13844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:13.057210 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:48190)
1211 15:03:13.057309 (+    99us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:13.057365 (+    56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20251211 15:03:13.057577 13294 leader_election.cc:304] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36fb0f4f5d140f5a34f891811372f74, d5d5706f9b8549af870a01843f6bc054; no voters: 
I20251211 15:03:13.057665 13845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:13.057414 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:48196)
1211 15:03:13.057544 (+   130us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:13.057598 (+    54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20251211 15:03:13.057753 13843 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20251211 15:03:13.057799 13110 leader_election.cc:336] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0299041a087e49eeaf7adbe9c2dd0756 (127.5.160.190:44329): Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
I20251211 15:03:13.057816 13843 raft_consensus.cc:493] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0299041a087e49eeaf7adbe9c2dd0756)
I20251211 15:03:13.057862 13843 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 1 FOLLOWER]: Advancing to term 2
W20251211 15:03:13.057752 13294 leader_election.cc:336] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0299041a087e49eeaf7adbe9c2dd0756 (127.5.160.190:44329): Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
I20251211 15:03:13.058260 13842 raft_consensus.cc:515] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } }
I20251211 15:03:13.058619 13842 leader_election.cc:290] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [CANDIDATE]: Term 2 election: Requested vote from peers 0299041a087e49eeaf7adbe9c2dd0756 (127.5.160.190:44329), b36fb0f4f5d140f5a34f891811372f74 (127.5.160.188:35895)
I20251211 15:03:13.058897 13843 raft_consensus.cc:515] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } }
I20251211 15:03:13.059007 13844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:13.058724 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:48212)
1211 15:03:13.058860 (+   136us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:13.058911 (+    51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20251211 15:03:13.059042 13319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d5d5706f9b8549af870a01843f6bc054" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b36fb0f4f5d140f5a34f891811372f74"
I20251211 15:03:13.059183 13319 raft_consensus.cc:2393] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d5d5706f9b8549af870a01843f6bc054 in current term 2: Already voted for candidate b36fb0f4f5d140f5a34f891811372f74 in this term.
I20251211 15:03:13.059265 13843 leader_election.cc:290] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [CANDIDATE]: Term 2 election: Requested vote from peers 0299041a087e49eeaf7adbe9c2dd0756 (127.5.160.190:44329), d5d5706f9b8549af870a01843f6bc054 (127.5.160.189:43525)
I20251211 15:03:13.059669 13845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:13.059443 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:48222)
1211 15:03:13.059559 (+   116us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:13.059607 (+    48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20251211 15:03:13.059767 13135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b36fb0f4f5d140f5a34f891811372f74" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d5d5706f9b8549af870a01843f6bc054"
I20251211 15:03:13.059906 13135 raft_consensus.cc:2393] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b36fb0f4f5d140f5a34f891811372f74 in current term 2: Already voted for candidate d5d5706f9b8549af870a01843f6bc054 in this term.
I20251211 15:03:13.060042 13844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:13.059774 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:48226)
1211 15:03:13.059935 (+   161us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:13.059980 (+    45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20251211 15:03:13.060129 13110 leader_election.cc:336] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0299041a087e49eeaf7adbe9c2dd0756 (127.5.160.190:44329): Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
I20251211 15:03:13.060191 13110 leader_election.cc:304] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5d5706f9b8549af870a01843f6bc054; no voters: 0299041a087e49eeaf7adbe9c2dd0756, b36fb0f4f5d140f5a34f891811372f74
I20251211 15:03:13.060322 13842 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251211 15:03:13.060468 13845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:13.060098 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:48236)
1211 15:03:13.060365 (+   267us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:13.060411 (+    46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204}
W20251211 15:03:13.060616 13294 leader_election.cc:336] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0299041a087e49eeaf7adbe9c2dd0756 (127.5.160.190:44329): Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
I20251211 15:03:13.060689 13294 leader_election.cc:304] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b36fb0f4f5d140f5a34f891811372f74; no voters: 0299041a087e49eeaf7adbe9c2dd0756, d5d5706f9b8549af870a01843f6bc054
I20251211 15:03:13.060808 13843 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251211 15:03:13.545845 13848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:13.545315 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.130:55933)
1211 15:03:13.545654 (+   339us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:13.545719 (+    65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":95,"threads_started":1}
I20251211 15:03:13.546481 13849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:13.546067 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.131:42747)
1211 15:03:13.546333 (+   266us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:13.546387 (+    54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":67,"threads_started":1}
I20251211 15:03:13.547693 13850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:13.547342 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.129:35823)
1211 15:03:13.547572 (+   230us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:13.547619 (+    47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":73,"threads_started":1}
I20251211 15:03:14.547302 13851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.546759 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.130:47579)
1211 15:03:14.547123 (+   364us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.547187 (+    64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":79,"threads_started":1}
I20251211 15:03:14.548075 13852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.547076 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.131:50543)
1211 15:03:14.547916 (+   840us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.547978 (+    62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":66,"threads_started":1}
I20251211 15:03:14.548552 13853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.548232 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.129:50977)
1211 15:03:14.548435 (+   203us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.548479 (+    44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":63,"threads_started":1}
I20251211 15:03:14.900933 13854 raft_consensus.cc:493] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:03:14.901080 13854 raft_consensus.cc:515] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } }
I20251211 15:03:14.901543 13854 leader_election.cc:290] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0299041a087e49eeaf7adbe9c2dd0756 (127.5.160.190:44329), d5d5706f9b8549af870a01843f6bc054 (127.5.160.189:43525)
I20251211 15:03:14.902216 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.901766 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:60418)
1211 15:03:14.902039 (+   273us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.902126 (+    87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":117,"threads_started":1}
I20251211 15:03:14.902376 13135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b36fb0f4f5d140f5a34f891811372f74" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d5d5706f9b8549af870a01843f6bc054" is_pre_election: true
I20251211 15:03:14.902508 13135 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b36fb0f4f5d140f5a34f891811372f74 in term 2.
I20251211 15:03:14.902995 13294 leader_election.cc:304] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36fb0f4f5d140f5a34f891811372f74, d5d5706f9b8549af870a01843f6bc054; no voters: 
I20251211 15:03:14.903074 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.902819 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:60430)
1211 15:03:14.902946 (+   127us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.902997 (+    51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20251211 15:03:14.903156 13294 leader_election.cc:336] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0299041a087e49eeaf7adbe9c2dd0756 (127.5.160.190:44329): Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
I20251211 15:03:14.903156 13854 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251211 15:03:14.903261 13854 raft_consensus.cc:493] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:03:14.903309 13854 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 2 FOLLOWER]: Advancing to term 3
I20251211 15:03:14.904269 13854 raft_consensus.cc:515] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } }
I20251211 15:03:14.904587 13854 leader_election.cc:290] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [CANDIDATE]: Term 3 election: Requested vote from peers 0299041a087e49eeaf7adbe9c2dd0756 (127.5.160.190:44329), d5d5706f9b8549af870a01843f6bc054 (127.5.160.189:43525)
I20251211 15:03:14.905015 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.904735 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:60438)
1211 15:03:14.904863 (+   128us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.904957 (+    94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20251211 15:03:14.905143 13135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b36fb0f4f5d140f5a34f891811372f74" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d5d5706f9b8549af870a01843f6bc054"
I20251211 15:03:14.905265 13135 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 2 FOLLOWER]: Advancing to term 3
I20251211 15:03:14.905706 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.905498 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:60440)
1211 15:03:14.905604 (+   106us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.905650 (+    46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20251211 15:03:14.905807 13294 leader_election.cc:336] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0299041a087e49eeaf7adbe9c2dd0756 (127.5.160.190:44329): Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
I20251211 15:03:14.906299 13135 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b36fb0f4f5d140f5a34f891811372f74 in term 3.
I20251211 15:03:14.906615 13294 leader_election.cc:304] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b36fb0f4f5d140f5a34f891811372f74, d5d5706f9b8549af870a01843f6bc054; no voters: 0299041a087e49eeaf7adbe9c2dd0756
I20251211 15:03:14.906777 13854 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 3 FOLLOWER]: Leader election won for term 3
I20251211 15:03:14.907060 13854 raft_consensus.cc:697] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [term 3 LEADER]: Becoming Leader. State: Replica: b36fb0f4f5d140f5a34f891811372f74, State: Running, Role: LEADER
I20251211 15:03:14.907344 13854 consensus_queue.cc:237] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } }
I20251211 15:03:14.908692 13857 sys_catalog.cc:455] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b36fb0f4f5d140f5a34f891811372f74. Latest consensus state: current_term: 3 leader_uuid: "b36fb0f4f5d140f5a34f891811372f74" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } } }
I20251211 15:03:14.908797 13857 sys_catalog.cc:458] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:14.909116 13859 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:03:14.911336 13859 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:03:14.911725 13859 catalog_manager.cc:1269] Loaded cluster ID: ef5f6ba1b13548aaa59b85d5085990c0
I20251211 15:03:14.911770 13859 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:03:14.912389 13859 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:03:14.912801 13859 catalog_manager.cc:6038] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: Loaded TSK: 0
I20251211 15:03:14.913455 13859 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 15:03:14.949120 13309 catalog_manager.cc:2257] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53642:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20251211 15:03:14.951740 13309 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:03:14.955075 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.954756 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:60464)
1211 15:03:14.954889 (+   133us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.954975 (+    86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20251211 15:03:14.955070 13135 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [term 3 FOLLOWER]: Refusing update from remote peer b36fb0f4f5d140f5a34f891811372f74: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20251211 15:03:14.955770 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.955520 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.0.0.1:60474)
1211 15:03:14.955627 (+   107us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.955681 (+    54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20251211 15:03:14.955796 13857 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20251211 15:03:14.956034 13294 consensus_peers.cc:597] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 -> Peer 0299041a087e49eeaf7adbe9c2dd0756 (127.5.160.190:44329): Couldn't send request to peer 0299041a087e49eeaf7adbe9c2dd0756. Status: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 15:03:14.957471 13861 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b36fb0f4f5d140f5a34f891811372f74. Latest consensus state: current_term: 3 leader_uuid: "b36fb0f4f5d140f5a34f891811372f74" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } } }
I20251211 15:03:14.957585 13861 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: This master's current role is: FOLLOWER
I20251211 15:03:14.958791 13857 sys_catalog.cc:455] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b36fb0f4f5d140f5a34f891811372f74" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } } }
I20251211 15:03:14.958905 13857 sys_catalog.cc:458] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:14.959441 13861 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b36fb0f4f5d140f5a34f891811372f74" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "0299041a087e49eeaf7adbe9c2dd0756" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 44329 } } peers { permanent_uuid: "d5d5706f9b8549af870a01843f6bc054" member_type: VOTER last_known_addr { host: "127.5.160.189" port: 43525 } attrs { promote: false } } peers { permanent_uuid: "b36fb0f4f5d140f5a34f891811372f74" member_type: VOTER last_known_addr { host: "127.5.160.188" port: 35895 } attrs { promote: false } } }
I20251211 15:03:14.959563 13861 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5d5706f9b8549af870a01843f6bc054 [sys.catalog]: This master's current role is: FOLLOWER
I20251211 15:03:14.959383 13862 mvcc.cc:204] Tried to move back new op lower bound from 7231346257730494464 to 7231346257542914048. Current Snapshot: MvccSnapshot[applied={T|T < 7231346257730494464}]
I20251211 15:03:14.967685 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.964501 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:33625 (local address 127.0.0.1:36472)
1211 15:03:14.964658 (+   157us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.964672 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:14.964759 (+    87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:14.965265 (+   506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:14.965270 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:14.965291 (+    21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:14.965542 (+   251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:14.965552 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.966526 (+   974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:14.966529 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:14.967305 (+   776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:14.967312 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.967405 (+    93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:14.967427 (+    22us) client_negotiation.cc:769] Sending connection context
1211 15:03:14.967472 (+    45us) client_negotiation.cc:240] Negotiation successful
1211 15:03:14.967545 (+    73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20251211 15:03:14.968317 13867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.964619 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36472 (local address 127.5.160.129:33625)
1211 15:03:14.964990 (+   371us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:14.964996 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:14.965010 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:03:14.965063 (+    53us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:14.965066 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:14.965129 (+    63us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:14.965215 (+    86us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:14.965666 (+   451us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.966428 (+   762us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:14.967419 (+   991us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.968014 (+   595us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:14.968057 (+    43us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:14.968109 (+    52us) server_negotiation.cc:300] Negotiation successful
1211 15:03:14.968189 (+    80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":72,"threads_started":1}
I20251211 15:03:14.968834 13868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.964870 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:40275 (local address 127.0.0.1:56754)
1211 15:03:14.965610 (+   740us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.965624 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:14.965701 (+    77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:14.966035 (+   334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:14.966037 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:14.966053 (+    16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:14.966299 (+   246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:14.966307 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.967205 (+   898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:14.967209 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:14.968295 (+  1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:14.968304 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.968579 (+   275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:14.968598 (+    19us) client_negotiation.cc:769] Sending connection context
1211 15:03:14.968655 (+    57us) client_negotiation.cc:240] Negotiation successful
1211 15:03:14.968712 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":103,"threads_started":1}
I20251211 15:03:14.969007 13437 tablet_service.cc:1505] Processing CreateTablet for tablet 7328041d84d9446faf21d760ddbe2259 (DEFAULT_TABLE table=test-table [id=a53e20c9f3d94953a7a22dc1f4f14277]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:14.969195 13869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.964929 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56754 (local address 127.5.160.130:40275)
1211 15:03:14.965692 (+   763us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:14.965697 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:14.965711 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:03:14.965822 (+   111us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:14.965826 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:14.965877 (+    51us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:14.965942 (+    65us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:14.966428 (+   486us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.967076 (+   648us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:14.968415 (+  1339us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.968889 (+   474us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:14.968930 (+    41us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:14.968982 (+    52us) server_negotiation.cc:300] Negotiation successful
1211 15:03:14.969047 (+    65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":72,"threads_started":1}
I20251211 15:03:14.969332 13437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7328041d84d9446faf21d760ddbe2259. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:14.969657 13573 tablet_service.cc:1505] Processing CreateTablet for tablet 7328041d84d9446faf21d760ddbe2259 (DEFAULT_TABLE table=test-table [id=a53e20c9f3d94953a7a22dc1f4f14277]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:14.969843 13870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.965133 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:43053 (local address 127.0.0.1:60286)
1211 15:03:14.965824 (+   691us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.965836 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:14.965908 (+    72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:14.966764 (+   856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:14.966767 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:14.966788 (+    21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:14.967035 (+   247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:14.967043 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.968045 (+  1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:14.968048 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:14.969471 (+  1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:14.969482 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.969588 (+   106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:14.969603 (+    15us) client_negotiation.cc:769] Sending connection context
1211 15:03:14.969647 (+    44us) client_negotiation.cc:240] Negotiation successful
1211 15:03:14.969722 (+    75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":91,"threads_started":1}
I20251211 15:03:14.969937 13573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7328041d84d9446faf21d760ddbe2259. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:14.970453 13871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.965369 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60286 (local address 127.5.160.131:43053)
1211 15:03:14.966550 (+  1181us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:14.966555 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:14.966569 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:03:14.966613 (+    44us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:14.966617 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:14.966664 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:14.966739 (+    75us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:14.967178 (+   439us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.967932 (+   754us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:14.969616 (+  1684us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.970160 (+   544us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:14.970196 (+    36us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:14.970250 (+    54us) server_negotiation.cc:300] Negotiation successful
1211 15:03:14.970316 (+    66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":82,"threads_started":1}
I20251211 15:03:14.971599 13709 tablet_service.cc:1505] Processing CreateTablet for tablet 7328041d84d9446faf21d760ddbe2259 (DEFAULT_TABLE table=test-table [id=a53e20c9f3d94953a7a22dc1f4f14277]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:14.971870 13709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7328041d84d9446faf21d760ddbe2259. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:14.972150 13873 tablet_bootstrap.cc:492] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab: Bootstrap starting.
I20251211 15:03:14.972445 13872 tablet_bootstrap.cc:492] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81: Bootstrap starting.
I20251211 15:03:14.972970 13873 tablet_bootstrap.cc:654] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:14.973366 13872 tablet_bootstrap.cc:654] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:14.974121 13873 tablet_bootstrap.cc:492] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab: No bootstrap required, opened a new log
I20251211 15:03:14.974291 13873 ts_tablet_manager.cc:1403] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:14.974462 13872 tablet_bootstrap.cc:492] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81: No bootstrap required, opened a new log
I20251211 15:03:14.974545 13872 ts_tablet_manager.cc:1403] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:03:14.974754 13873 raft_consensus.cc:359] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } } peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } }
I20251211 15:03:14.974848 13873 raft_consensus.cc:385] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:14.974869 13873 raft_consensus.cc:740] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e8b567337e43e685d75b1cf1e5c8ab, State: Initialized, Role: FOLLOWER
I20251211 15:03:14.974905 13872 raft_consensus.cc:359] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } } peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } }
I20251211 15:03:14.975035 13872 raft_consensus.cc:385] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:14.975073 13872 raft_consensus.cc:740] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7461d2a9bca462b968a0041aeffac81, State: Initialized, Role: FOLLOWER
I20251211 15:03:14.975046 13873 consensus_queue.cc:260] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } } peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } }
I20251211 15:03:14.975145 13876 tablet_bootstrap.cc:492] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d: Bootstrap starting.
I20251211 15:03:14.975210 13872 consensus_queue.cc:260] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } } peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } }
I20251211 15:03:14.975409 13873 ts_tablet_manager.cc:1434] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20251211 15:03:14.975538 13872 ts_tablet_manager.cc:1434] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20251211 15:03:14.976163 13851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.975770 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.130:41867)
1211 15:03:14.976035 (+   265us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.976090 (+    55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187}
I20251211 15:03:14.976426 13853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.976071 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.129:39507)
1211 15:03:14.976319 (+   248us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.976365 (+    46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171}
I20251211 15:03:14.977176 13851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.976772 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.130:34503)
1211 15:03:14.977065 (+   293us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.977111 (+    46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226}
I20251211 15:03:14.978693 13503 heartbeater.cc:499] Master 127.5.160.188:35895 was elected leader, sending a full tablet report...
I20251211 15:03:14.978783 13876 tablet_bootstrap.cc:654] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:14.979627 13853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.979376 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.129:39557)
1211 15:03:14.979500 (+   124us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.979554 (+    54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20251211 15:03:14.980652 13876 tablet_bootstrap.cc:492] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d: No bootstrap required, opened a new log
I20251211 15:03:14.980734 13876 ts_tablet_manager.cc:1403] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d: Time spent bootstrapping tablet: real 0.006s	user 0.001s	sys 0.001s
I20251211 15:03:14.981145 13876 raft_consensus.cc:359] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } } peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } }
I20251211 15:03:14.981236 13876 raft_consensus.cc:385] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:14.981258 13876 raft_consensus.cc:740] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68b2237f121640b3a6b46e60e5274e0d, State: Initialized, Role: FOLLOWER
I20251211 15:03:14.981376 13876 consensus_queue.cc:260] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } } peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } }
I20251211 15:03:14.981698 13876 ts_tablet_manager.cc:1434] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20251211 15:03:14.982323 13852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.982111 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.131:43651)
1211 15:03:14.982203 (+    92us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.982254 (+    51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20251211 15:03:14.983297 13775 heartbeater.cc:499] Master 127.5.160.188:35895 was elected leader, sending a full tablet report...
I20251211 15:03:14.983969 13852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.983656 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.131:38917)
1211 15:03:14.983860 (+   204us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.983901 (+    41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20251211 15:03:14.991750 13880 raft_consensus.cc:493] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:03:14.991899 13880 raft_consensus.cc:515] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } } peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } }
I20251211 15:03:14.992972 13880 leader_election.cc:290] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7461d2a9bca462b968a0041aeffac81 (127.5.160.129:33625), 08e8b567337e43e685d75b1cf1e5c8ab (127.5.160.130:40275)
I20251211 15:03:14.996688 13852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.993154 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:33625 (local address 127.5.160.131:44863)
1211 15:03:14.993395 (+   241us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.993410 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:14.993517 (+   107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:14.993779 (+   262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:14.993782 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:14.993798 (+    16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:14.994145 (+   347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:14.994153 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.995268 (+  1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:14.995273 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:14.996214 (+   941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:14.996226 (+    12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.996347 (+   121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:14.996371 (+    24us) client_negotiation.cc:769] Sending connection context
1211 15:03:14.996421 (+    50us) client_negotiation.cc:240] Negotiation successful
1211 15:03:14.996491 (+    70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172}
I20251211 15:03:14.996721 13881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.993221 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:40275 (local address 127.5.160.131:59445)
1211 15:03:14.993552 (+   331us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:14.993564 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:14.993639 (+    75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:14.993906 (+   267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:14.993909 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:14.993923 (+    14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:14.994145 (+   222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:14.994162 (+    17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.995282 (+  1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:14.995285 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:14.996229 (+   944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:14.996235 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.996385 (+   150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:14.996398 (+    13us) client_negotiation.cc:769] Sending connection context
1211 15:03:14.996441 (+    43us) client_negotiation.cc:240] Negotiation successful
1211 15:03:14.996486 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":121,"threads_started":1}
I20251211 15:03:14.997085 13869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.993323 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:59445 (local address 127.5.160.130:40275)
1211 15:03:14.993459 (+   136us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:14.993463 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:14.993621 (+   158us) server_negotiation.cc:408] Connection header received
1211 15:03:14.993719 (+    98us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:14.993722 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:14.993770 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:14.993838 (+    68us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:14.994297 (+   459us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.995141 (+   844us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:14.996400 (+  1259us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.996827 (+   427us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:14.996880 (+    53us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:14.996931 (+    51us) server_negotiation.cc:300] Negotiation successful
1211 15:03:14.996991 (+    60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20251211 15:03:14.997349 13867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:14.993258 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:44863 (local address 127.5.160.129:33625)
1211 15:03:14.993394 (+   136us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:14.993399 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:14.993495 (+    96us) server_negotiation.cc:408] Connection header received
1211 15:03:14.993619 (+   124us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:14.993622 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:14.993681 (+    59us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:14.993766 (+    85us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:14.994295 (+   529us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.995136 (+   841us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:14.996569 (+  1433us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:14.997080 (+   511us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:14.997119 (+    39us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:14.997170 (+    51us) server_negotiation.cc:300] Negotiation successful
1211 15:03:14.997234 (+    64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20251211 15:03:14.997498 13593 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7328041d84d9446faf21d760ddbe2259" candidate_uuid: "68b2237f121640b3a6b46e60e5274e0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" is_pre_election: true
I20251211 15:03:14.997641 13593 raft_consensus.cc:2468] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68b2237f121640b3a6b46e60e5274e0d in term 0.
I20251211 15:03:14.997881 13457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7328041d84d9446faf21d760ddbe2259" candidate_uuid: "68b2237f121640b3a6b46e60e5274e0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7461d2a9bca462b968a0041aeffac81" is_pre_election: true
I20251211 15:03:14.997992 13663 leader_election.cc:304] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e8b567337e43e685d75b1cf1e5c8ab, 68b2237f121640b3a6b46e60e5274e0d; no voters: 
I20251211 15:03:14.998078 13457 raft_consensus.cc:2468] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68b2237f121640b3a6b46e60e5274e0d in term 0.
I20251211 15:03:14.998246 13880 raft_consensus.cc:2804] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:03:14.998308 13880 raft_consensus.cc:493] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:03:14.998348 13880 raft_consensus.cc:3060] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:14.999388 13880 raft_consensus.cc:515] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } } peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } }
I20251211 15:03:14.999749 13880 leader_election.cc:290] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [CANDIDATE]: Term 1 election: Requested vote from peers d7461d2a9bca462b968a0041aeffac81 (127.5.160.129:33625), 08e8b567337e43e685d75b1cf1e5c8ab (127.5.160.130:40275)
I20251211 15:03:15.000070 13457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7328041d84d9446faf21d760ddbe2259" candidate_uuid: "68b2237f121640b3a6b46e60e5274e0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7461d2a9bca462b968a0041aeffac81"
I20251211 15:03:15.000144 13593 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7328041d84d9446faf21d760ddbe2259" candidate_uuid: "68b2237f121640b3a6b46e60e5274e0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e8b567337e43e685d75b1cf1e5c8ab"
I20251211 15:03:15.000195 13457 raft_consensus.cc:3060] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:15.000257 13593 raft_consensus.cc:3060] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:15.001240 13457 raft_consensus.cc:2468] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68b2237f121640b3a6b46e60e5274e0d in term 1.
I20251211 15:03:15.001240 13593 raft_consensus.cc:2468] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68b2237f121640b3a6b46e60e5274e0d in term 1.
I20251211 15:03:15.001538 13663 leader_election.cc:304] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e8b567337e43e685d75b1cf1e5c8ab, 68b2237f121640b3a6b46e60e5274e0d; no voters: 
I20251211 15:03:15.001732 13880 raft_consensus.cc:2804] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:15.001996 13880 raft_consensus.cc:697] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [term 1 LEADER]: Becoming Leader. State: Replica: 68b2237f121640b3a6b46e60e5274e0d, State: Running, Role: LEADER
I20251211 15:03:15.002241 13880 consensus_queue.cc:237] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } } peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } }
I20251211 15:03:15.002707 13881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:15.002473 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.131:60405)
1211 15:03:15.002592 (+   119us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:15.002640 (+    48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20251211 15:03:15.004807 13307 catalog_manager.cc:5654] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 68b2237f121640b3a6b46e60e5274e0d (127.5.160.131). New cstate: current_term: 1 leader_uuid: "68b2237f121640b3a6b46e60e5274e0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68b2237f121640b3a6b46e60e5274e0d" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43053 } health_report { overall_health: HEALTHY } } }
I20251211 15:03:15.023645 13871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:15.020313 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60294 (local address 127.5.160.131:43053)
1211 15:03:15.020475 (+   162us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:15.020479 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:15.020493 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:03:15.020576 (+    83us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:15.020578 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:15.020632 (+    54us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:15.020715 (+    83us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:03:15.021132 (+   417us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:15.021619 (+   487us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:15.022351 (+   732us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:15.022507 (+   156us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:15.022564 (+    57us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:03:15.023188 (+   624us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:03:15.023289 (+   101us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:15.023437 (+   148us) server_negotiation.cc:300] Negotiation successful
1211 15:03:15.023499 (+    62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20251211 15:03:15.026567 13593 raft_consensus.cc:1275] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab [term 1 FOLLOWER]: Refusing update from remote peer 68b2237f121640b3a6b46e60e5274e0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:03:15.026774 13457 raft_consensus.cc:1275] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81 [term 1 FOLLOWER]: Refusing update from remote peer 68b2237f121640b3a6b46e60e5274e0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:03:15.027184 13882 consensus_queue.cc:1048] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e8b567337e43e685d75b1cf1e5c8ab" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 40275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:15.027344 13880 consensus_queue.cc:1048] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7461d2a9bca462b968a0041aeffac81" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:15.028712 13639 heartbeater.cc:499] Master 127.5.160.188:35895 was elected leader, sending a full tablet report...
I20251211 15:03:15.029523 13851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:15.029213 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.130:38637)
1211 15:03:15.029385 (+   172us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:15.029444 (+    59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20251211 15:03:15.029541 13853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:15.029238 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.129:49665)
1211 15:03:15.029409 (+   171us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:15.029465 (+    56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20251211 15:03:15.033253 13886 mvcc.cc:204] Tried to move back new op lower bound from 7231346258023919616 to 7231346257931821056. Current Snapshot: MvccSnapshot[applied={T|T < 7231346258023919616}]
I20251211 15:03:15.034293 13881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:15.034029 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.131:39753)
1211 15:03:15.034129 (+   100us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:15.034187 (+    58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20251211 15:03:15.035693 13851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:15.035330 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.130:59621)
1211 15:03:15.035563 (+   233us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:15.035614 (+    51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160}
I20251211 15:03:15.039934 13853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:15.039482 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:44329 (local address 127.5.160.129:34423)
1211 15:03:15.039772 (+   290us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:15.039833 (+    61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:44329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203}
I20251211 15:03:15.040056 13309 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53642:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:03:15.040206 13309 catalog_manager.cc:2755] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53642:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:03:15.043817 13309 catalog_manager.cc:5941] T 00000000000000000000000000000000 P b36fb0f4f5d140f5a34f891811372f74: Sending DeleteTablet for 3 replicas of tablet 7328041d84d9446faf21d760ddbe2259
I20251211 15:03:15.044471 13437 tablet_service.cc:1552] Processing DeleteTablet for tablet 7328041d84d9446faf21d760ddbe2259 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:15 UTC) from {username='oryx', principal='oryx/127.5.160.188@KRBTEST.COM'} at 127.0.0.1:36472
I20251211 15:03:15.044795 13709 tablet_service.cc:1552] Processing DeleteTablet for tablet 7328041d84d9446faf21d760ddbe2259 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:15 UTC) from {username='oryx', principal='oryx/127.5.160.188@KRBTEST.COM'} at 127.0.0.1:60286
I20251211 15:03:15.044828 13573 tablet_service.cc:1552] Processing DeleteTablet for tablet 7328041d84d9446faf21d760ddbe2259 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:15 UTC) from {username='oryx', principal='oryx/127.5.160.188@KRBTEST.COM'} at 127.0.0.1:56754
I20251211 15:03:15.045152 13895 tablet_replica.cc:333] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81: stopping tablet replica
I20251211 15:03:15.045150 13896 tablet_replica.cc:333] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d: stopping tablet replica
I20251211 15:03:15.045267 13895 raft_consensus.cc:2243] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:03:15.045272 13896 raft_consensus.cc:2243] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [term 1 LEADER]: Raft consensus shutting down.
I20251211 15:03:15.045395 13895 raft_consensus.cc:2272] T 7328041d84d9446faf21d760ddbe2259 P d7461d2a9bca462b968a0041aeffac81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:15.045601 13896 raft_consensus.cc:2272] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:15.046135  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 13374
I20251211 15:03:15.046993 13896 ts_tablet_manager.cc:1916] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:15.049592 13896 ts_tablet_manager.cc:1929] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:03:15.049712 13896 log.cc:1199] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1765465326787564-5762-0/minicluster-data/ts-2/wal/wals/7328041d84d9446faf21d760ddbe2259
I20251211 15:03:15.050007 13896 ts_tablet_manager.cc:1950] T 7328041d84d9446faf21d760ddbe2259 P 68b2237f121640b3a6b46e60e5274e0d: Deleting consensus metadata
I20251211 15:03:15.050984 13295 catalog_manager.cc:4985] TS 68b2237f121640b3a6b46e60e5274e0d (127.5.160.131:43053): tablet 7328041d84d9446faf21d760ddbe2259 (table test-table [id=a53e20c9f3d94953a7a22dc1f4f14277]) successfully deleted
I20251211 15:03:15.053558 13897 tablet_replica.cc:333] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab: stopping tablet replica
I20251211 15:03:15.053781 13897 raft_consensus.cc:2243] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:03:15.054008 13897 raft_consensus.cc:2272] T 7328041d84d9446faf21d760ddbe2259 P 08e8b567337e43e685d75b1cf1e5c8ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:15.054129  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 13510
W20251211 15:03:15.054199 13870 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:15.053853 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:33625 (local address 127.0.0.1:36482)
1211 15:03:15.054049 (+   196us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:15.054100 (+    51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.129:33625: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":118}
W20251211 15:03:15.055033 13296 catalog_manager.cc:4712] TS d7461d2a9bca462b968a0041aeffac81 (127.5.160.129:33625): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7328041d84d9446faf21d760ddbe2259: Network error: Client connection negotiation failed: client connection to 127.5.160.129:33625: connect: Connection reset by peer (error 104)
I20251211 15:03:15.059799  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 13646
I20251211 15:03:15.061517 13870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:15.059875 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:40275 (local address 127.0.0.1:56770)
1211 15:03:15.061353 (+  1478us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:15.061414 (+    61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.130:40275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1370}
I20251211 15:03:15.065176  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 12985
I20251211 15:03:15.070237  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 13097
2025-12-11T15:03:15Z chronyd exiting
[       OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (9298 ms)
[ RUN      ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:03:15 dist-test-slave-4k3m krb5kdc[13900](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:03:15 dist-test-slave-4k3m krb5kdc[13900](info): set up 2 sockets
Dec 11 15:03:15 dist-test-slave-4k3m krb5kdc[13900](info): commencing operation
krb5kdc: starting...
W20251211 15:03:16.935882  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.843s	user 0.001s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:03:17 dist-test-slave-4k3m krb5kdc[13900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465397, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:03:17Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:03:17Z Disabled control of system clock
WARNING: no policy specified for oryx/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal oryx/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
I20251211 15:03:17.076220  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:35081
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:35081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:17.185673 13916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:17.185931 13916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:17.185989 13916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:17.189445 13916 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:03:17.189522 13916 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20251211 15:03:17.189540 13916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:17.189563 13916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:17.189579 13916 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:03:17.189594 13916 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:03:17.194169 13916 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:35081
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:35081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:17.195303 13916 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:17.196122 13916 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:17.202131 13921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:17.202135 13924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:17.202131 13922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:17.202437 13916 server_base.cc:1047] running on GCE node
I20251211 15:03:17.203001 13916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:17.203941 13916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:17.205106 13916 hybrid_clock.cc:648] HybridClock initialized: now 1765465397205079 us; error 44 us; skew 500 ppm
Dec 11 15:03:17 dist-test-slave-4k3m krb5kdc[13900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465397, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:17.207809 13916 init.cc:377] Logged in from keytab as oryx/127.5.160.190@KRBTEST.COM (short username oryx)
I20251211 15:03:17.208951 13916 webserver.cc:492] Webserver started at http://127.5.160.190:39755/ using document root <none> and password file <none>
I20251211 15:03:17.209486 13916 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:17.209535 13916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:17.209725 13916 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:17.211562 13916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "0eb5ffd1cc03441f8e8ee25066f4d2ef"
format_stamp: "Formatted at 2025-12-11 15:03:17 on dist-test-slave-4k3m"
server_key: "2432c9612ef41be81ca75de75df2ffe5"
server_key_iv: "2280c233346172818516357493617ac5"
server_key_version: "encryptionkey@0"
I20251211 15:03:17.212039 13916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "0eb5ffd1cc03441f8e8ee25066f4d2ef"
format_stamp: "Formatted at 2025-12-11 15:03:17 on dist-test-slave-4k3m"
server_key: "2432c9612ef41be81ca75de75df2ffe5"
server_key_iv: "2280c233346172818516357493617ac5"
server_key_version: "encryptionkey@0"
I20251211 15:03:17.215520 13916 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20251211 15:03:17.217841 13931 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:17.218886 13916 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:17.219098 13916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "0eb5ffd1cc03441f8e8ee25066f4d2ef"
format_stamp: "Formatted at 2025-12-11 15:03:17 on dist-test-slave-4k3m"
server_key: "2432c9612ef41be81ca75de75df2ffe5"
server_key_iv: "2280c233346172818516357493617ac5"
server_key_version: "encryptionkey@0"
I20251211 15:03:17.219202 13916 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:17.252565 13916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:17.255699 13916 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:17.255898 13916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:17.263900 13916 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:35081
I20251211 15:03:17.264161 13993 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:35081 every 8 connection(s)
I20251211 15:03:17.264940 13916 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:03:17.267690 13994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:17.272773  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 13916
I20251211 15:03:17.272924  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:03:17.272939 13994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef: Bootstrap starting.
I20251211 15:03:17.273164  5762 external_mini_cluster.cc:1468] Setting key 0e18e34b04de31c2368d77cd77d8d5cf
I20251211 15:03:17.275514 13994 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:17.276244 13994 log.cc:826] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:17.278013 13994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef: No bootstrap required, opened a new log
Dec 11 15:03:17 dist-test-slave-4k3m krb5kdc[13900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465397, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
I20251211 15:03:17.281088 13994 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eb5ffd1cc03441f8e8ee25066f4d2ef" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 35081 } }
I20251211 15:03:17.281288 13994 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:17.281339 13994 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0eb5ffd1cc03441f8e8ee25066f4d2ef, State: Initialized, Role: FOLLOWER
I20251211 15:03:17.281822 13994 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eb5ffd1cc03441f8e8ee25066f4d2ef" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 35081 } }
I20251211 15:03:17.281952 13994 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:03:17.282016 13994 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:03:17.282099 13994 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:17.282900 13994 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eb5ffd1cc03441f8e8ee25066f4d2ef" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 35081 } }
I20251211 15:03:17.283265 13994 leader_election.cc:304] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0eb5ffd1cc03441f8e8ee25066f4d2ef; no voters: 
I20251211 15:03:17.283545 13994 leader_election.cc:290] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:03:17.283640 13999 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:17.283787 13999 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [term 1 LEADER]: Becoming Leader. State: Replica: 0eb5ffd1cc03441f8e8ee25066f4d2ef, State: Running, Role: LEADER
I20251211 15:03:17.284077 13999 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eb5ffd1cc03441f8e8ee25066f4d2ef" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 35081 } }
I20251211 15:03:17.284701 13994 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:03:17.285756 14001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0eb5ffd1cc03441f8e8ee25066f4d2ef. Latest consensus state: current_term: 1 leader_uuid: "0eb5ffd1cc03441f8e8ee25066f4d2ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eb5ffd1cc03441f8e8ee25066f4d2ef" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 35081 } } }
I20251211 15:03:17.285876 14001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:17.285915 13997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:17.274502 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56748 (local address 127.5.160.190:35081)
1211 15:03:17.274987 (+   485us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:17.274999 (+    12us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:17.275036 (+    37us) server_negotiation.cc:408] Connection header received
1211 15:03:17.275660 (+   624us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:17.275681 (+    21us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:17.276001 (+   320us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:17.276321 (+   320us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:17.277213 (+   892us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.277932 (+   719us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:17.278616 (+   684us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.278887 (+   271us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:17.281190 (+  2303us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:17.281215 (+    25us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:17.281227 (+    12us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:17.281262 (+    35us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:17.283141 (+  1879us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:17.283587 (+   446us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:17.283594 (+     7us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:17.283599 (+     5us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:17.283697 (+    98us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:17.284006 (+   309us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:17.284009 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:17.284011 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:17.284430 (+   419us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:17.284627 (+   197us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:17.284882 (+   255us) server_negotiation.cc:300] Negotiation successful
1211 15:03:17.285160 (+   278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":148,"threads_started":1}
I20251211 15:03:17.285737 14000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0eb5ffd1cc03441f8e8ee25066f4d2ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eb5ffd1cc03441f8e8ee25066f4d2ef" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 35081 } } }
I20251211 15:03:17.286497 14000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:17.286794 14008 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:03:17.290095 14008 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:03:17.295776 14008 catalog_manager.cc:1357] Generated new cluster ID: 448f48ff6e304df7a0787fa4c800de61
I20251211 15:03:17.295873 14008 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:03:17.309741 14008 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:03:17.310869 14008 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:03:17.321343 14008 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef: Generated new TSK 0
I20251211 15:03:17.322078 14008 catalog_manager.cc:1524] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal oryx/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
WARNING: no policy specified for HTTP/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
I20251211 15:03:17.381688  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:35081
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:17.490003 14022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:17.490238 14022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:17.490304 14022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:17.493640 14022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:17.493713 14022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:17.493773 14022 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20251211 15:03:17.493839 14022 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:03:17.498271 14022 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--webserver_require_spnego=true
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.160.190:35081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:17.499416 14022 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:17.500252 14022 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:17.506846 14028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:17.507009 14022 server_base.cc:1047] running on GCE node
W20251211 15:03:17.507078 14027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:17.507015 14030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:17.508184 14022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:17.508723 14022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:17.509876 14022 hybrid_clock.cc:648] HybridClock initialized: now 1765465397509867 us; error 34 us; skew 500 ppm
Dec 11 15:03:17 dist-test-slave-4k3m krb5kdc[13900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465397, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:17.512482 14022 init.cc:377] Logged in from keytab as oryx/127.5.160.129@KRBTEST.COM (short username oryx)
I20251211 15:03:17.513511 14022 webserver.cc:492] Webserver started at http://127.5.160.129:40051/ using document root <none> and password file <none>
I20251211 15:03:17.514039 14022 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:17.514086 14022 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:17.514241 14022 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:17.515949 14022 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "f3844f00bc7448949291a528b57e92b4"
format_stamp: "Formatted at 2025-12-11 15:03:17 on dist-test-slave-4k3m"
server_key: "1452e2c165934b92b179fc3c534a8610"
server_key_iv: "9e0db7e112b3fce1903b359e96455b74"
server_key_version: "encryptionkey@0"
I20251211 15:03:17.516377 14022 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "f3844f00bc7448949291a528b57e92b4"
format_stamp: "Formatted at 2025-12-11 15:03:17 on dist-test-slave-4k3m"
server_key: "1452e2c165934b92b179fc3c534a8610"
server_key_iv: "9e0db7e112b3fce1903b359e96455b74"
server_key_version: "encryptionkey@0"
I20251211 15:03:17.519754 14022 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20251211 15:03:17.522011 14037 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:17.523075 14022 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:17.523202 14022 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "f3844f00bc7448949291a528b57e92b4"
format_stamp: "Formatted at 2025-12-11 15:03:17 on dist-test-slave-4k3m"
server_key: "1452e2c165934b92b179fc3c534a8610"
server_key_iv: "9e0db7e112b3fce1903b359e96455b74"
server_key_version: "encryptionkey@0"
I20251211 15:03:17.523300 14022 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:17.550066 14022 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:17.553525 14022 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:17.553730 14022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:17.555294 14022 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:17.555348 14022 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:17.555388 14022 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:17.555415 14022 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
Dec 11 15:03:17 dist-test-slave-4k3m krb5kdc[13900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465397, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
I20251211 15:03:17.565968 14022 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:40277
I20251211 15:03:17.566066 14152 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:40277 every 8 connection(s)
I20251211 15:03:17.567149 14022 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:03:17.567651  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 14022
I20251211 15:03:17.567770  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:03:17.567962  5762 external_mini_cluster.cc:1468] Setting key 3e78c8eb4fb961b89b53d6167960ac3a
I20251211 15:03:17.568440 13997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:17.556024 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:55855 (local address 127.5.160.190:35081)
1211 15:03:17.556143 (+   119us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:17.556147 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:17.557044 (+   897us) server_negotiation.cc:408] Connection header received
1211 15:03:17.557925 (+   881us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:17.557929 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:17.557990 (+    61us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:17.558063 (+    73us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:17.559647 (+  1584us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.560173 (+   526us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:17.560843 (+   670us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.561037 (+   194us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:17.564506 (+  3469us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:17.564537 (+    31us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:17.564542 (+     5us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:17.564582 (+    40us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:17.566264 (+  1682us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:17.566826 (+   562us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:17.566829 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:17.566830 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:17.566874 (+    44us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:17.567237 (+   363us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:17.567241 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:17.567243 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:17.567439 (+   196us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:17.567533 (+    94us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:17.568125 (+   592us) server_negotiation.cc:300] Negotiation successful
1211 15:03:17.568282 (+   157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20251211 15:03:17.569092 14046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:17.556373 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:35081 (local address 127.5.160.129:55855)
1211 15:03:17.556855 (+   482us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:17.556891 (+    36us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:17.557726 (+   835us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:17.558252 (+   526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:17.558264 (+    12us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:17.558793 (+   529us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:17.559464 (+   671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:17.559479 (+    15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.560307 (+   828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:17.560310 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:17.560734 (+   424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:17.560743 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.560978 (+   235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:17.561643 (+   665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:17.561684 (+    41us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:17.564275 (+  2591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:17.566403 (+  2128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:17.566410 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:17.566422 (+    12us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:17.566730 (+   308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:17.566982 (+   252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:17.566986 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:17.566988 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:17.567103 (+   115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:17.567550 (+   447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:17.567557 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:17.567838 (+   281us) client_negotiation.cc:769] Sending connection context
1211 15:03:17.568055 (+   217us) client_negotiation.cc:240] Negotiation successful
1211 15:03:17.568326 (+   271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":136,"threads_started":1}
I20251211 15:03:17.570993 14153 heartbeater.cc:344] Connected to a master server at 127.5.160.190:35081
I20251211 15:03:17.571238 14153 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:17.571853 14153 heartbeater.cc:507] Master 127.5.160.190:35081 requested a full tablet report, sending...
I20251211 15:03:17.573439 13948 ts_manager.cc:194] Registered new tserver with Master: f3844f00bc7448949291a528b57e92b4 (127.5.160.129:40277)
I20251211 15:03:17.575013 13948 master_service.cc:502] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:55855
WARNING: no policy specified for oryx/127.5.160.130@KRBTEST.COM; defaulting to no policy
I20251211 15:03:17.580612 13997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:17.573603 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:60783 (local address 127.5.160.190:35081)
1211 15:03:17.573731 (+   128us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:17.573735 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:17.573963 (+   228us) server_negotiation.cc:408] Connection header received
1211 15:03:17.574076 (+   113us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:17.574080 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:17.574131 (+    51us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:17.574213 (+    82us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:17.574858 (+   645us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.575631 (+   773us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:17.576273 (+   642us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.576458 (+   185us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:17.577300 (+   842us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:17.577318 (+    18us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:17.577321 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:17.577343 (+    22us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:17.578783 (+  1440us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:17.579366 (+   583us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:17.579370 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:17.579372 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:17.579420 (+    48us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:17.579637 (+   217us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:17.579640 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:17.579642 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:17.579947 (+   305us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:17.580069 (+   122us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:17.580356 (+   287us) server_negotiation.cc:300] Negotiation successful
1211 15:03:17.580469 (+   113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20251211 15:03:17.580632 14160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:17.573526 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:35081 (local address 127.5.160.129:60783)
1211 15:03:17.573855 (+   329us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:17.573869 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:17.573984 (+   115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:17.574255 (+   271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:17.574259 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:17.574459 (+   200us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:17.574739 (+   280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:17.574746 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.575737 (+   991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:17.575741 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:17.576166 (+   425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:17.576174 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.576278 (+   104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:17.576863 (+   585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:17.576875 (+    12us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:17.577192 (+   317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:17.578923 (+  1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:17.578960 (+    37us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:17.578962 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:17.579244 (+   282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:17.579504 (+   260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:17.579507 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:17.579509 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:17.579557 (+    48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:17.580070 (+   513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:17.580074 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:17.580195 (+   121us) client_negotiation.cc:769] Sending connection context
1211 15:03:17.580289 (+    94us) client_negotiation.cc:240] Negotiation successful
1211 15:03:17.580438 (+   149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":107,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal oryx/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
WARNING: no policy specified for HTTP/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
I20251211 15:03:17.616101  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:35081
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:17.724001 14164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:17.724248 14164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:17.724331 14164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:17.727836 14164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:17.727919 14164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:17.727996 14164 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20251211 15:03:17.728065 14164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:03:17.732743 14164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--webserver_require_spnego=true
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.160.190:35081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:17.733956 14164 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:17.734844 14164 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:17.741899 14172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:17.742096 14164 server_base.cc:1047] running on GCE node
W20251211 15:03:17.742002 14170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:17.741904 14169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:17.742724 14164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:17.743459 14164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:17.744638 14164 hybrid_clock.cc:648] HybridClock initialized: now 1765465397744627 us; error 28 us; skew 500 ppm
Dec 11 15:03:17 dist-test-slave-4k3m krb5kdc[13900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465397, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:17.747539 14164 init.cc:377] Logged in from keytab as oryx/127.5.160.130@KRBTEST.COM (short username oryx)
I20251211 15:03:17.748688 14164 webserver.cc:492] Webserver started at http://127.5.160.130:41103/ using document root <none> and password file <none>
I20251211 15:03:17.749341 14164 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:17.749421 14164 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:17.749627 14164 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:17.751577 14164 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "8cfc2aac65784a7cb858a53ad09c2087"
format_stamp: "Formatted at 2025-12-11 15:03:17 on dist-test-slave-4k3m"
server_key: "8fd4731ea07844e9d3d7fb2a9acc03ab"
server_key_iv: "96fcce4555b88e5f5e0cbfcf1a1d649e"
server_key_version: "encryptionkey@0"
I20251211 15:03:17.752089 14164 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "8cfc2aac65784a7cb858a53ad09c2087"
format_stamp: "Formatted at 2025-12-11 15:03:17 on dist-test-slave-4k3m"
server_key: "8fd4731ea07844e9d3d7fb2a9acc03ab"
server_key_iv: "96fcce4555b88e5f5e0cbfcf1a1d649e"
server_key_version: "encryptionkey@0"
I20251211 15:03:17.755808 14164 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20251211 15:03:17.758271 14179 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:17.759498 14164 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:17.759624 14164 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "8cfc2aac65784a7cb858a53ad09c2087"
format_stamp: "Formatted at 2025-12-11 15:03:17 on dist-test-slave-4k3m"
server_key: "8fd4731ea07844e9d3d7fb2a9acc03ab"
server_key_iv: "96fcce4555b88e5f5e0cbfcf1a1d649e"
server_key_version: "encryptionkey@0"
I20251211 15:03:17.759730 14164 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:17.778806 14164 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:17.781831 14164 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:17.782029 14164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:17.783635 14164 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:17.783692 14164 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:17.783744 14164 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:17.783771 14164 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
Dec 11 15:03:17 dist-test-slave-4k3m krb5kdc[13900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465397, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
I20251211 15:03:17.794741 14164 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:45303
I20251211 15:03:17.795895 14164 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:03:17.796377 13997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:17.784242 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:57413 (local address 127.5.160.190:35081)
1211 15:03:17.784393 (+   151us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:17.784398 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:17.785081 (+   683us) server_negotiation.cc:408] Connection header received
1211 15:03:17.786054 (+   973us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:17.786060 (+     6us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:17.786122 (+    62us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:17.786245 (+   123us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:17.788084 (+  1839us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.788857 (+   773us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:17.789744 (+   887us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.789925 (+   181us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:17.792379 (+  2454us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:17.792400 (+    21us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:17.792402 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:17.792429 (+    27us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:17.794082 (+  1653us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:17.794696 (+   614us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:17.794700 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:17.794702 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:17.794758 (+    56us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:17.795150 (+   392us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:17.795154 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:17.795156 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:17.795361 (+   205us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:17.795462 (+   101us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:17.796068 (+   606us) server_negotiation.cc:300] Negotiation successful
1211 15:03:17.796213 (+   145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20251211 15:03:17.796669 14294 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:45303 every 8 connection(s)
I20251211 15:03:17.797063 14188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:17.784493 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:35081 (local address 127.5.160.130:57413)
1211 15:03:17.784928 (+   435us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:17.784971 (+    43us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:17.785820 (+   849us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:17.786528 (+   708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:17.786537 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:17.787351 (+   814us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:17.787921 (+   570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:17.787935 (+    14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.788979 (+  1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:17.788983 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:17.789551 (+   568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:17.789563 (+    12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.789806 (+   243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:17.790450 (+   644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:17.790487 (+    37us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:17.792224 (+  1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:17.794239 (+  2015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:17.794244 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:17.794253 (+     9us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:17.794560 (+   307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:17.794881 (+   321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:17.794885 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:17.794888 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:17.795052 (+   164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:17.795494 (+   442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:17.795500 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:17.795740 (+   240us) client_negotiation.cc:769] Sending connection context
1211 15:03:17.796003 (+   263us) client_negotiation.cc:240] Negotiation successful
1211 15:03:17.796275 (+   272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":101,"threads_started":1}
I20251211 15:03:17.798210 14295 heartbeater.cc:344] Connected to a master server at 127.5.160.190:35081
I20251211 15:03:17.798373 14295 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:17.798977 14295 heartbeater.cc:507] Master 127.5.160.190:35081 requested a full tablet report, sending...
I20251211 15:03:17.800083 13947 ts_manager.cc:194] Registered new tserver with Master: 8cfc2aac65784a7cb858a53ad09c2087 (127.5.160.130:45303)
I20251211 15:03:17.800822 13947 master_service.cc:502] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.160.130@KRBTEST.COM'} at 127.5.160.130:57413
I20251211 15:03:17.802032  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 14164
I20251211 15:03:17.802140  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:03:17.802404  5762 external_mini_cluster.cc:1468] Setting key a5fe59348a526ec3f9fdd100b0e62981
I20251211 15:03:17.806651 13997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:17.800476 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:58351 (local address 127.5.160.190:35081)
1211 15:03:17.800592 (+   116us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:17.800596 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:17.800688 (+    92us) server_negotiation.cc:408] Connection header received
1211 15:03:17.800781 (+    93us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:17.800785 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:17.800832 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:17.800917 (+    85us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:17.801607 (+   690us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.802099 (+   492us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:17.802738 (+   639us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.802912 (+   174us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:17.803806 (+   894us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:17.803821 (+    15us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:17.803823 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:17.803847 (+    24us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:17.805229 (+  1382us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:17.805612 (+   383us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:17.805616 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:17.805617 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:17.805661 (+    44us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:17.805864 (+   203us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:17.805868 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:17.805870 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:17.806053 (+   183us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:17.806137 (+    84us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:17.806386 (+   249us) server_negotiation.cc:300] Negotiation successful
1211 15:03:17.806498 (+   112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20251211 15:03:17.806668 14301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:17.800388 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:35081 (local address 127.5.160.130:58351)
1211 15:03:17.800616 (+   228us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:17.800629 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:17.800711 (+    82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:17.800991 (+   280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:17.800994 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:17.801199 (+   205us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:17.801477 (+   278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:17.801486 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.802248 (+   762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:17.802251 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:17.802635 (+   384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:17.802643 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:17.802742 (+    99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:17.803292 (+   550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:17.803304 (+    12us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:17.803666 (+   362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:17.805347 (+  1681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:17.805351 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:17.805353 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:17.805525 (+   172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:17.805741 (+   216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:17.805744 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:17.805746 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:17.805791 (+    45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:17.806142 (+   351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:17.806145 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:17.806238 (+    93us) client_negotiation.cc:769] Sending connection context
1211 15:03:17.806325 (+    87us) client_negotiation.cc:240] Negotiation successful
1211 15:03:17.806478 (+   153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":74,"threads_started":1}
WARNING: no policy specified for oryx/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal oryx/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
WARNING: no policy specified for HTTP/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab.
I20251211 15:03:17.853834  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:35081
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:45133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:17.964577 14306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:17.964802 14306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:17.964870 14306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:17.968101 14306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:17.968165 14306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:17.968217 14306 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20251211 15:03:17.968258 14306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:03:17.972613 14306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:45133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/krb5kdc/oryx.keytab
--principal=oryx/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--webserver_require_spnego=true
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.160.190:35081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:17.973665 14306 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:17.974463 14306 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:17.981166 14314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:17.981160 14312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:17.981164 14311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:17.981415 14306 server_base.cc:1047] running on GCE node
I20251211 15:03:17.981770 14306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:17.982306 14306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:17.983453 14306 hybrid_clock.cc:648] HybridClock initialized: now 1765465397983444 us; error 25 us; skew 500 ppm
Dec 11 15:03:17 dist-test-slave-4k3m krb5kdc[13900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465397, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:17.986063 14306 init.cc:377] Logged in from keytab as oryx/127.5.160.131@KRBTEST.COM (short username oryx)
I20251211 15:03:17.987221 14306 webserver.cc:492] Webserver started at http://127.5.160.131:40309/ using document root <none> and password file <none>
I20251211 15:03:17.987733 14306 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:17.987777 14306 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:17.987941 14306 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:17.989641 14306 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "bd32e8d91cb6468e84d61da64e6b09a7"
format_stamp: "Formatted at 2025-12-11 15:03:17 on dist-test-slave-4k3m"
server_key: "40ce968d9e420cdec9c6e351b620ffcd"
server_key_iv: "9db2f9a9862651f25398db57aed29686"
server_key_version: "encryptionkey@0"
I20251211 15:03:17.990116 14306 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "bd32e8d91cb6468e84d61da64e6b09a7"
format_stamp: "Formatted at 2025-12-11 15:03:17 on dist-test-slave-4k3m"
server_key: "40ce968d9e420cdec9c6e351b620ffcd"
server_key_iv: "9db2f9a9862651f25398db57aed29686"
server_key_version: "encryptionkey@0"
I20251211 15:03:17.993531 14306 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.004s
I20251211 15:03:17.995918 14321 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:17.997000 14306 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20251211 15:03:17.997098 14306 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "bd32e8d91cb6468e84d61da64e6b09a7"
format_stamp: "Formatted at 2025-12-11 15:03:17 on dist-test-slave-4k3m"
server_key: "40ce968d9e420cdec9c6e351b620ffcd"
server_key_iv: "9db2f9a9862651f25398db57aed29686"
server_key_version: "encryptionkey@0"
I20251211 15:03:17.997186 14306 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:18.010543 14306 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:18.013908 14306 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:18.014075 14306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:18.015633 14306 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:18.015697 14306 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:18.015753 14306 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:18.015782 14306 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
Dec 11 15:03:18 dist-test-slave-4k3m krb5kdc[13900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465397, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
I20251211 15:03:18.025983 14306 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:32929
I20251211 15:03:18.026010 14436 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:32929 every 8 connection(s)
I20251211 15:03:18.026906 14306 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
I20251211 15:03:18.027091 13997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.016245 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:58159 (local address 127.5.160.190:35081)
1211 15:03:18.016401 (+   156us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.016406 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.017170 (+   764us) server_negotiation.cc:408] Connection header received
1211 15:03:18.018051 (+   881us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.018055 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.018115 (+    60us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.018190 (+    75us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:18.019796 (+  1606us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.020323 (+   527us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.021000 (+   677us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.021218 (+   218us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.023539 (+  2321us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:18.023566 (+    27us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:18.023570 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:18.023603 (+    33us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:18.025222 (+  1619us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:18.025690 (+   468us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:18.025694 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:18.025696 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:18.025757 (+    61us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:18.026021 (+   264us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:18.026025 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:18.026027 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:18.026215 (+   188us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:18.026305 (+    90us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.026768 (+   463us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.026894 (+   126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20251211 15:03:18.027783 14330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.016544 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:35081 (local address 127.5.160.131:58159)
1211 15:03:18.016996 (+   452us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:18.017040 (+    44us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:18.017831 (+   791us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:18.018379 (+   548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:18.018390 (+    11us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:18.018848 (+   458us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:18.019621 (+   773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.019636 (+    15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.020454 (+   818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.020457 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:18.020878 (+   421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.020885 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.021119 (+   234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.021827 (+   708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:18.021864 (+    37us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:18.023377 (+  1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:18.025335 (+  1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:18.025341 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:18.025370 (+    29us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:18.025596 (+   226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:18.025848 (+   252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:18.025850 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:18.025852 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:18.025941 (+    89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:18.026316 (+   375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:18.026323 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:18.026542 (+   219us) client_negotiation.cc:769] Sending connection context
1211 15:03:18.026720 (+   178us) client_negotiation.cc:240] Negotiation successful
1211 15:03:18.027020 (+   300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":108,"threads_started":1}
I20251211 15:03:18.029017 14437 heartbeater.cc:344] Connected to a master server at 127.5.160.190:35081
I20251211 15:03:18.029168 14437 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:18.029714 14437 heartbeater.cc:507] Master 127.5.160.190:35081 requested a full tablet report, sending...
I20251211 15:03:18.029729  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 14306
I20251211 15:03:18.029850  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:03:18.030108  5762 external_mini_cluster.cc:1468] Setting key 6ae4bca7b46826f4e3ecc97b9c0ad5e7
I20251211 15:03:18.030743 13948 ts_manager.cc:194] Registered new tserver with Master: bd32e8d91cb6468e84d61da64e6b09a7 (127.5.160.131:32929)
I20251211 15:03:18.031502 13948 master_service.cc:502] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.160.131@KRBTEST.COM'} at 127.5.160.131:58159
I20251211 15:03:18.031973  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251211 15:03:18.037667 14443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.031146 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:35081 (local address 127.5.160.131:46061)
1211 15:03:18.031430 (+   284us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:18.031441 (+    11us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:18.031531 (+    90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:18.031849 (+   318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:18.031852 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:18.032104 (+   252us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:18.032380 (+   276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.032388 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.033101 (+   713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.033105 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:18.033617 (+   512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.033627 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.033741 (+   114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.034342 (+   601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:18.034358 (+    16us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:18.034707 (+   349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:18.036345 (+  1638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:18.036349 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:18.036351 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:18.036567 (+   216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:18.036797 (+   230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:18.036801 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:18.036803 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:18.036860 (+    57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:18.037182 (+   322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:18.037185 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:18.037276 (+    91us) client_negotiation.cc:769] Sending connection context
1211 15:03:18.037382 (+   106us) client_negotiation.cc:240] Negotiation successful
1211 15:03:18.037521 (+   139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":93,"threads_started":1}
I20251211 15:03:18.037707 13997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.031141 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:46061 (local address 127.5.160.190:35081)
1211 15:03:18.031259 (+   118us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.031264 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.031507 (+   243us) server_negotiation.cc:408] Connection header received
1211 15:03:18.031672 (+   165us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.031676 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.031725 (+    49us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.031797 (+    72us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:18.032516 (+   719us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.032991 (+   475us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.033755 (+   764us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.034037 (+   282us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.034839 (+   802us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:18.034859 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:18.034862 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:18.034886 (+    24us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:18.036232 (+  1346us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:18.036665 (+   433us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:18.036668 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:18.036670 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:18.036714 (+    44us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:18.036942 (+   228us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:18.036946 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:18.036948 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:18.037095 (+   147us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:18.037202 (+   107us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.037430 (+   228us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.037555 (+   125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Dec 11 15:03:18 dist-test-slave-4k3m krb5kdc[13900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465398, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM: 
Dec 11 15:03:18 dist-test-slave-4k3m krb5kdc[13900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  test-user@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:18 dist-test-slave-4k3m krb5kdc[13900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  test-user@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
W20251211 15:03:18.055814 13997 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:18.049982 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56756 (local address 127.5.160.190:35081)
1211 15:03:18.050143 (+   161us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.050148 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.050162 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:03:18.050202 (+    40us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.050205 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.050247 (+    42us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.050325 (+    78us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:18.051234 (+   909us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.051751 (+   517us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.052471 (+   720us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.052635 (+   164us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.055663 (+  3028us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56756: BlockingRecv error: recv got EOF from 127.0.0.1:56756 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Dec 11 15:03:18 dist-test-slave-4k3m krb5kdc[13900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465398, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
I20251211 15:03:18.064661 13997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.057199 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56772 (local address 127.5.160.190:35081)
1211 15:03:18.057312 (+   113us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.057315 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.057360 (+    45us) server_negotiation.cc:408] Connection header received
1211 15:03:18.057471 (+   111us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.057473 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.057516 (+    43us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.057586 (+    70us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:18.058244 (+   658us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.058711 (+   467us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.059399 (+   688us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.059573 (+   174us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.061585 (+  2012us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:18.061605 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:18.061607 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:18.061644 (+    37us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:18.063260 (+  1616us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:18.063606 (+   346us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:18.063609 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:18.063610 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:18.063659 (+    49us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:18.063959 (+   300us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:18.063963 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:18.063964 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:18.064127 (+   163us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:18.064245 (+   118us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.064429 (+   184us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.064525 (+    96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20251211 15:03:18.067250 13947 catalog_manager.cc:2257] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56772:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20251211 15:03:18.069581 13947 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:03:18.082327 14460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.077978 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:40277 (local address 127.0.0.1:48606)
1211 15:03:18.078461 (+   483us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:18.078475 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:18.078587 (+   112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:18.079674 (+  1087us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:18.079677 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:18.079693 (+    16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:18.079915 (+   222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.079924 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.081160 (+  1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.081163 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:18.081980 (+   817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.081988 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.082086 (+    98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.082100 (+    14us) client_negotiation.cc:769] Sending connection context
1211 15:03:18.082152 (+    52us) client_negotiation.cc:240] Negotiation successful
1211 15:03:18.082197 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":113,"threads_started":1}
I20251211 15:03:18.082327 14459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.077793 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:45303 (local address 127.0.0.1:46286)
1211 15:03:18.078402 (+   609us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:18.078441 (+    39us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:18.078587 (+   146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:18.079392 (+   805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:18.079398 (+     6us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:18.079421 (+    23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:18.079730 (+   309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.079739 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.080970 (+  1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.080973 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:18.081814 (+   841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.081823 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.081918 (+    95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.081981 (+    63us) client_negotiation.cc:769] Sending connection context
1211 15:03:18.082062 (+    81us) client_negotiation.cc:240] Negotiation successful
1211 15:03:18.082161 (+    99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":80,"threads_started":1}
I20251211 15:03:18.083506 14461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.077961 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46286 (local address 127.5.160.130:45303)
1211 15:03:18.078864 (+   903us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.078880 (+    16us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.078903 (+    23us) server_negotiation.cc:408] Connection header received
1211 15:03:18.079011 (+   108us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.079016 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.079197 (+   181us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.079377 (+   180us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:18.079845 (+   468us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.080805 (+   960us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.082674 (+  1869us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.083203 (+   529us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.083285 (+    82us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.083335 (+    50us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.083398 (+    63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":798,"thread_start_us":126,"threads_started":1}
I20251211 15:03:18.083529 14463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.078477 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48606 (local address 127.5.160.129:40277)
1211 15:03:18.078863 (+   386us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.078870 (+     7us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.078892 (+    22us) server_negotiation.cc:408] Connection header received
1211 15:03:18.078999 (+   107us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.079005 (+     6us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.079203 (+   198us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.079680 (+   477us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:18.080037 (+   357us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.081054 (+  1017us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.082100 (+  1046us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.083107 (+  1007us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.083229 (+   122us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.083294 (+    65us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.083388 (+    94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":80,"threads_started":1}
I20251211 15:03:18.083652 14464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.078821 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34874 (local address 127.5.160.131:32929)
1211 15:03:18.079288 (+   467us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.079294 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.079845 (+   551us) server_negotiation.cc:408] Connection header received
1211 15:03:18.079912 (+    67us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.079915 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.080059 (+   144us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.080194 (+   135us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:18.080528 (+   334us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.081445 (+   917us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.082772 (+  1327us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.083314 (+   542us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.083397 (+    83us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.083452 (+    55us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.083528 (+    76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":205,"threads_started":1}
I20251211 15:03:18.083853 14462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.078441 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:32929 (local address 127.0.0.1:34874)
1211 15:03:18.079440 (+   999us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:18.079453 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:18.079526 (+    73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:18.080186 (+   660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:18.080189 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:18.080208 (+    19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:18.080419 (+   211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.080426 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.081543 (+  1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.081547 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:18.082156 (+   609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.082167 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.082278 (+   111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.082296 (+    18us) client_negotiation.cc:769] Sending connection context
1211 15:03:18.082340 (+    44us) client_negotiation.cc:240] Negotiation successful
1211 15:03:18.082395 (+    55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":938,"thread_start_us":83,"threads_started":1}
I20251211 15:03:18.086470 14229 tablet_service.cc:1505] Processing CreateTablet for tablet cbec81d74d5b45f1b070a76eae7dcf7d (DEFAULT_TABLE table=test-table [id=e2e5b51c2bf84d109738963f72de4b85]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:18.086470 14087 tablet_service.cc:1505] Processing CreateTablet for tablet cbec81d74d5b45f1b070a76eae7dcf7d (DEFAULT_TABLE table=test-table [id=e2e5b51c2bf84d109738963f72de4b85]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:18.087131 14371 tablet_service.cc:1505] Processing CreateTablet for tablet cbec81d74d5b45f1b070a76eae7dcf7d (DEFAULT_TABLE table=test-table [id=e2e5b51c2bf84d109738963f72de4b85]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:18.087541 14087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbec81d74d5b45f1b070a76eae7dcf7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:18.087541 14229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbec81d74d5b45f1b070a76eae7dcf7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:18.087909 14371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbec81d74d5b45f1b070a76eae7dcf7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:18.093156 14465 tablet_bootstrap.cc:492] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7: Bootstrap starting.
I20251211 15:03:18.094532 14466 tablet_bootstrap.cc:492] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4: Bootstrap starting.
I20251211 15:03:18.096182 14465 tablet_bootstrap.cc:654] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:18.096531 14466 tablet_bootstrap.cc:654] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:18.097357 14465 log.cc:826] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:18.097357 14466 log.cc:826] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:18.098013 14467 tablet_bootstrap.cc:492] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087: Bootstrap starting.
I20251211 15:03:18.099171 14466 tablet_bootstrap.cc:492] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4: No bootstrap required, opened a new log
I20251211 15:03:18.099335 14465 tablet_bootstrap.cc:492] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7: No bootstrap required, opened a new log
I20251211 15:03:18.099361 14466 ts_tablet_manager.cc:1403] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20251211 15:03:18.099545 14465 ts_tablet_manager.cc:1403] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7: Time spent bootstrapping tablet: real 0.007s	user 0.005s	sys 0.000s
I20251211 15:03:18.100134 14467 tablet_bootstrap.cc:654] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:18.101332 14467 log.cc:826] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:18.102201 14466 raft_consensus.cc:359] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.102387 14466 raft_consensus.cc:385] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:18.102438 14466 raft_consensus.cc:740] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3844f00bc7448949291a528b57e92b4, State: Initialized, Role: FOLLOWER
I20251211 15:03:18.102723 14465 raft_consensus.cc:359] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.102823 14466 consensus_queue.cc:260] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.102918 14465 raft_consensus.cc:385] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:18.103006 14465 raft_consensus.cc:740] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd32e8d91cb6468e84d61da64e6b09a7, State: Initialized, Role: FOLLOWER
I20251211 15:03:18.103354 14467 tablet_bootstrap.cc:492] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087: No bootstrap required, opened a new log
I20251211 15:03:18.103394 14465 consensus_queue.cc:260] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.103560 14467 ts_tablet_manager.cc:1403] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20251211 15:03:18.103627 14466 ts_tablet_manager.cc:1434] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20251211 15:03:18.103987 14153 heartbeater.cc:499] Master 127.5.160.190:35081 was elected leader, sending a full tablet report...
I20251211 15:03:18.104187 14465 ts_tablet_manager.cc:1434] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20251211 15:03:18.104527 14437 heartbeater.cc:499] Master 127.5.160.190:35081 was elected leader, sending a full tablet report...
I20251211 15:03:18.106539 14467 raft_consensus.cc:359] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.106775 14467 raft_consensus.cc:385] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:18.106832 14467 raft_consensus.cc:740] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cfc2aac65784a7cb858a53ad09c2087, State: Initialized, Role: FOLLOWER
I20251211 15:03:18.107275 14467 consensus_queue.cc:260] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.108088 14295 heartbeater.cc:499] Master 127.5.160.190:35081 was elected leader, sending a full tablet report...
I20251211 15:03:18.108121 14467 ts_tablet_manager.cc:1434] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20251211 15:03:18.143229 14471 raft_consensus.cc:493] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:03:18.143419 14471 raft_consensus.cc:515] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.144652 14471 leader_election.cc:290] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cfc2aac65784a7cb858a53ad09c2087 (127.5.160.130:45303), bd32e8d91cb6468e84d61da64e6b09a7 (127.5.160.131:32929)
I20251211 15:03:18.148273 14474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.144903 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:32929 (local address 127.5.160.129:43063)
1211 15:03:18.145244 (+   341us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:18.145256 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:18.145382 (+   126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:18.145665 (+   283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:18.145668 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:18.145683 (+    15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:18.145996 (+   313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.146007 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.146994 (+   987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.146998 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:18.147838 (+   840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.147848 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.147981 (+   133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.148003 (+    22us) client_negotiation.cc:769] Sending connection context
1211 15:03:18.148050 (+    47us) client_negotiation.cc:240] Negotiation successful
1211 15:03:18.148111 (+    61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":132,"threads_started":1}
I20251211 15:03:18.148633 14475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.144816 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:45303 (local address 127.5.160.129:55379)
1211 15:03:18.145196 (+   380us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:18.145211 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:18.145363 (+   152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:18.145637 (+   274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:18.145641 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:18.145663 (+    22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:18.146394 (+   731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.146399 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.147263 (+   864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.147267 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:18.148085 (+   818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.148093 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.148192 (+    99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.148206 (+    14us) client_negotiation.cc:769] Sending connection context
1211 15:03:18.148247 (+    41us) client_negotiation.cc:240] Negotiation successful
1211 15:03:18.148297 (+    50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"spinlock_wait_cycles":5504,"thread_start_us":132,"threads_started":1}
I20251211 15:03:18.148725 14464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.145100 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:43063 (local address 127.5.160.131:32929)
1211 15:03:18.145216 (+   116us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.145220 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.145316 (+    96us) server_negotiation.cc:408] Connection header received
1211 15:03:18.145513 (+   197us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.145516 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.145567 (+    51us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.145635 (+    68us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:18.146131 (+   496us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.146782 (+   651us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.147996 (+  1214us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.148461 (+   465us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.148500 (+    39us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.148548 (+    48us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.148605 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20251211 15:03:18.148912 14461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.144949 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:55379 (local address 127.5.160.130:45303)
1211 15:03:18.145108 (+   159us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.145113 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.145287 (+   174us) server_negotiation.cc:408] Connection header received
1211 15:03:18.145458 (+   171us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.145462 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.145512 (+    50us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.145582 (+    70us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:18.146519 (+   937us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.147158 (+   639us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.148205 (+  1047us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.148655 (+   450us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.148689 (+    34us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.148735 (+    46us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.148792 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20251211 15:03:18.149394 14391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbec81d74d5b45f1b070a76eae7dcf7d" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" is_pre_election: true
I20251211 15:03:18.149420 14249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbec81d74d5b45f1b070a76eae7dcf7d" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cfc2aac65784a7cb858a53ad09c2087" is_pre_election: true
I20251211 15:03:18.149653 14249 raft_consensus.cc:2468] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 0.
I20251211 15:03:18.149655 14391 raft_consensus.cc:2468] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 0.
I20251211 15:03:18.150077 14039 leader_election.cc:304] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd32e8d91cb6468e84d61da64e6b09a7, f3844f00bc7448949291a528b57e92b4; no voters: 
I20251211 15:03:18.150305 14471 raft_consensus.cc:2804] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:03:18.150370 14471 raft_consensus.cc:493] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:03:18.150416 14471 raft_consensus.cc:3060] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:18.151404 14471 raft_consensus.cc:515] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.151773 14471 leader_election.cc:290] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 election: Requested vote from peers 8cfc2aac65784a7cb858a53ad09c2087 (127.5.160.130:45303), bd32e8d91cb6468e84d61da64e6b09a7 (127.5.160.131:32929)
I20251211 15:03:18.152149 14249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbec81d74d5b45f1b070a76eae7dcf7d" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cfc2aac65784a7cb858a53ad09c2087"
I20251211 15:03:18.152149 14391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cbec81d74d5b45f1b070a76eae7dcf7d" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd32e8d91cb6468e84d61da64e6b09a7"
I20251211 15:03:18.152281 14391 raft_consensus.cc:3060] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:18.152281 14249 raft_consensus.cc:3060] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:18.153482 14391 raft_consensus.cc:2468] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 1.
I20251211 15:03:18.153482 14249 raft_consensus.cc:2468] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 1.
I20251211 15:03:18.153832 14038 leader_election.cc:304] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cfc2aac65784a7cb858a53ad09c2087, f3844f00bc7448949291a528b57e92b4; no voters: 
I20251211 15:03:18.154032 14471 raft_consensus.cc:2804] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:18.154282 14471 raft_consensus.cc:697] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [term 1 LEADER]: Becoming Leader. State: Replica: f3844f00bc7448949291a528b57e92b4, State: Running, Role: LEADER
I20251211 15:03:18.154590 14471 consensus_queue.cc:237] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.157876 13946 catalog_manager.cc:5654] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3844f00bc7448949291a528b57e92b4 (127.5.160.129). New cstate: current_term: 1 leader_uuid: "f3844f00bc7448949291a528b57e92b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20251211 15:03:18.169072 14463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.166070 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48608 (local address 127.5.160.129:40277)
1211 15:03:18.166231 (+   161us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.166236 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.166250 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:03:18.166320 (+    70us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.166323 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.166376 (+    53us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.166457 (+    81us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:03:18.166790 (+   333us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.167386 (+   596us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.168021 (+   635us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.168202 (+   181us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.168258 (+    56us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:03:18.168702 (+   444us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:03:18.168802 (+   100us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.168885 (+    83us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.168938 (+    53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20251211 15:03:18.174480 14249 raft_consensus.cc:1275] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Refusing update from remote peer f3844f00bc7448949291a528b57e92b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:03:18.174484 14391 raft_consensus.cc:1275] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Refusing update from remote peer f3844f00bc7448949291a528b57e92b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:03:18.175175 14476 consensus_queue.cc:1048] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:18.175347 14471 consensus_queue.cc:1048] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:18.184098 14480 mvcc.cc:204] Tried to move back new op lower bound from 7231346270916173824 to 7231346270844116992. Current Snapshot: MvccSnapshot[applied={T|T < 7231346270916173824}]
I20251211 15:03:18.193252 13948 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56772:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:03:18.193419 13948 catalog_manager.cc:2755] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56772:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:03:18.196066 13948 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef: Sending DeleteTablet for 3 replicas of tablet cbec81d74d5b45f1b070a76eae7dcf7d
I20251211 15:03:18.196993 14229 tablet_service.cc:1552] Processing DeleteTablet for tablet cbec81d74d5b45f1b070a76eae7dcf7d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:18 UTC) from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:46286
I20251211 15:03:18.197070 14371 tablet_service.cc:1552] Processing DeleteTablet for tablet cbec81d74d5b45f1b070a76eae7dcf7d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:18 UTC) from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:34874
I20251211 15:03:18.197155 14087 tablet_service.cc:1552] Processing DeleteTablet for tablet cbec81d74d5b45f1b070a76eae7dcf7d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:18 UTC) from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:48606
I20251211 15:03:18.197685 14492 tablet_replica.cc:333] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7: stopping tablet replica
I20251211 15:03:18.197827 14493 tablet_replica.cc:333] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4: stopping tablet replica
I20251211 15:03:18.197834 13948 catalog_manager.cc:2257] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56772:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20251211 15:03:18.197980 14492 raft_consensus.cc:2243] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:03:18.198017 14493 raft_consensus.cc:2243] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [term 1 LEADER]: Raft consensus shutting down.
W20251211 15:03:18.198302 13948 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:03:18.198324 14492 raft_consensus.cc:2272] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:18.198379 14493 raft_consensus.cc:2272] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:18.198740 14491 tablet_replica.cc:333] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087: stopping tablet replica
I20251211 15:03:18.199112 14491 raft_consensus.cc:2243] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:03:18.199414 14491 raft_consensus.cc:2272] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:18.200217 14492 ts_tablet_manager.cc:1916] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:18.200788 14493 ts_tablet_manager.cc:1916] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:18.202345 14491 ts_tablet_manager.cc:1916] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:18.202859 14492 ts_tablet_manager.cc:1929] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:03:18.202977 14492 log.cc:1199] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/wal/wals/cbec81d74d5b45f1b070a76eae7dcf7d
I20251211 15:03:18.203290 14492 ts_tablet_manager.cc:1950] T cbec81d74d5b45f1b070a76eae7dcf7d P bd32e8d91cb6468e84d61da64e6b09a7: Deleting consensus metadata
I20251211 15:03:18.204466 13933 catalog_manager.cc:4985] TS bd32e8d91cb6468e84d61da64e6b09a7 (127.5.160.131:32929): tablet cbec81d74d5b45f1b070a76eae7dcf7d (table test-table [id=e2e5b51c2bf84d109738963f72de4b85]) successfully deleted
I20251211 15:03:18.205627 14087 tablet_service.cc:1505] Processing CreateTablet for tablet 6deaa43f096f47859184fbe3f31d4cc8 (DEFAULT_TABLE table=test-table [id=2a6d2f10bff64f02aecb86edad6514f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:18.205886 14087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6deaa43f096f47859184fbe3f31d4cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:18.206221 14371 tablet_service.cc:1505] Processing CreateTablet for tablet 6deaa43f096f47859184fbe3f31d4cc8 (DEFAULT_TABLE table=test-table [id=2a6d2f10bff64f02aecb86edad6514f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:18.206462 14371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6deaa43f096f47859184fbe3f31d4cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:18.206456 14491 ts_tablet_manager.cc:1929] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:03:18.206539 14491 log.cc:1199] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/wal/wals/cbec81d74d5b45f1b070a76eae7dcf7d
I20251211 15:03:18.206832 14491 ts_tablet_manager.cc:1950] T cbec81d74d5b45f1b070a76eae7dcf7d P 8cfc2aac65784a7cb858a53ad09c2087: Deleting consensus metadata
I20251211 15:03:18.208056 13932 catalog_manager.cc:4985] TS 8cfc2aac65784a7cb858a53ad09c2087 (127.5.160.130:45303): tablet cbec81d74d5b45f1b070a76eae7dcf7d (table test-table [id=e2e5b51c2bf84d109738963f72de4b85]) successfully deleted
I20251211 15:03:18.208112 14466 tablet_bootstrap.cc:492] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4: Bootstrap starting.
I20251211 15:03:18.208611 14465 tablet_bootstrap.cc:492] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7: Bootstrap starting.
I20251211 15:03:18.209072 14493 ts_tablet_manager.cc:1929] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:03:18.209153 14493 log.cc:1199] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/wal/wals/cbec81d74d5b45f1b070a76eae7dcf7d
I20251211 15:03:18.209235 14466 tablet_bootstrap.cc:654] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:18.209425 14493 ts_tablet_manager.cc:1950] T cbec81d74d5b45f1b070a76eae7dcf7d P f3844f00bc7448949291a528b57e92b4: Deleting consensus metadata
I20251211 15:03:18.209617 14465 tablet_bootstrap.cc:654] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:18.210601 13933 catalog_manager.cc:4985] TS f3844f00bc7448949291a528b57e92b4 (127.5.160.129:40277): tablet cbec81d74d5b45f1b070a76eae7dcf7d (table test-table [id=e2e5b51c2bf84d109738963f72de4b85]) successfully deleted
I20251211 15:03:18.210784 14466 tablet_bootstrap.cc:492] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4: No bootstrap required, opened a new log
I20251211 15:03:18.210861 14466 ts_tablet_manager.cc:1403] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20251211 15:03:18.210844 14229 tablet_service.cc:1505] Processing CreateTablet for tablet 6deaa43f096f47859184fbe3f31d4cc8 (DEFAULT_TABLE table=test-table [id=2a6d2f10bff64f02aecb86edad6514f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:18.211141 14229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6deaa43f096f47859184fbe3f31d4cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:18.211342 14466 raft_consensus.cc:359] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.211450 14466 raft_consensus.cc:385] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:18.211481 14466 raft_consensus.cc:740] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3844f00bc7448949291a528b57e92b4, State: Initialized, Role: FOLLOWER
I20251211 15:03:18.211606 14466 consensus_queue.cc:260] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.211840 14466 ts_tablet_manager.cc:1434] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20251211 15:03:18.213100 14467 tablet_bootstrap.cc:492] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087: Bootstrap starting.
I20251211 15:03:18.214084 14467 tablet_bootstrap.cc:654] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:18.214669 14465 tablet_bootstrap.cc:492] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7: No bootstrap required, opened a new log
I20251211 15:03:18.214749 14465 ts_tablet_manager.cc:1403] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7: Time spent bootstrapping tablet: real 0.006s	user 0.002s	sys 0.000s
I20251211 15:03:18.215260 14465 raft_consensus.cc:359] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.215371 14465 raft_consensus.cc:385] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:18.215407 14465 raft_consensus.cc:740] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd32e8d91cb6468e84d61da64e6b09a7, State: Initialized, Role: FOLLOWER
I20251211 15:03:18.215529 14465 consensus_queue.cc:260] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.215636 14467 tablet_bootstrap.cc:492] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087: No bootstrap required, opened a new log
I20251211 15:03:18.215727 14467 ts_tablet_manager.cc:1403] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20251211 15:03:18.215772 14465 ts_tablet_manager.cc:1434] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20251211 15:03:18.216192 14467 raft_consensus.cc:359] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.216296 14467 raft_consensus.cc:385] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:18.216325 14467 raft_consensus.cc:740] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cfc2aac65784a7cb858a53ad09c2087, State: Initialized, Role: FOLLOWER
I20251211 15:03:18.216444 14467 consensus_queue.cc:260] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.216670 14467 ts_tablet_manager.cc:1434] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
W20251211 15:03:18.278030 14438 tablet.cc:2378] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251211 15:03:18.297422 14296 tablet.cc:2378] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 15:03:18.312104 14489 raft_consensus.cc:493] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:03:18.312276 14489 raft_consensus.cc:515] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.312750 14489 leader_election.cc:290] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cfc2aac65784a7cb858a53ad09c2087 (127.5.160.130:45303), bd32e8d91cb6468e84d61da64e6b09a7 (127.5.160.131:32929)
I20251211 15:03:18.313264 14391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6deaa43f096f47859184fbe3f31d4cc8" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" is_pre_election: true
I20251211 15:03:18.313242 14249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6deaa43f096f47859184fbe3f31d4cc8" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cfc2aac65784a7cb858a53ad09c2087" is_pre_election: true
I20251211 15:03:18.313400 14391 raft_consensus.cc:2468] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 0.
I20251211 15:03:18.313421 14249 raft_consensus.cc:2468] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 0.
I20251211 15:03:18.313719 14039 leader_election.cc:304] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd32e8d91cb6468e84d61da64e6b09a7, f3844f00bc7448949291a528b57e92b4; no voters: 
I20251211 15:03:18.313894 14489 raft_consensus.cc:2804] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:03:18.313967 14489 raft_consensus.cc:493] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:03:18.314008 14489 raft_consensus.cc:3060] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:18.315057 14489 raft_consensus.cc:515] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.315622 14489 leader_election.cc:290] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 election: Requested vote from peers 8cfc2aac65784a7cb858a53ad09c2087 (127.5.160.130:45303), bd32e8d91cb6468e84d61da64e6b09a7 (127.5.160.131:32929)
I20251211 15:03:18.315789 14249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6deaa43f096f47859184fbe3f31d4cc8" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cfc2aac65784a7cb858a53ad09c2087"
I20251211 15:03:18.315930 14249 raft_consensus.cc:3060] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:18.315979 14391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6deaa43f096f47859184fbe3f31d4cc8" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd32e8d91cb6468e84d61da64e6b09a7"
I20251211 15:03:18.316113 14391 raft_consensus.cc:3060] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:18.316932 14391 raft_consensus.cc:2468] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 1.
I20251211 15:03:18.317034 14249 raft_consensus.cc:2468] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 1.
I20251211 15:03:18.317234 14039 leader_election.cc:304] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd32e8d91cb6468e84d61da64e6b09a7, f3844f00bc7448949291a528b57e92b4; no voters: 
I20251211 15:03:18.317410 14489 raft_consensus.cc:2804] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:18.317528 14489 raft_consensus.cc:697] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [term 1 LEADER]: Becoming Leader. State: Replica: f3844f00bc7448949291a528b57e92b4, State: Running, Role: LEADER
I20251211 15:03:18.317689 14489 consensus_queue.cc:237] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
W20251211 15:03:18.318465 14154 tablet.cc:2378] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 15:03:18.319483 13948 catalog_manager.cc:5654] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3844f00bc7448949291a528b57e92b4 (127.5.160.129). New cstate: current_term: 1 leader_uuid: "f3844f00bc7448949291a528b57e92b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } health_report { overall_health: UNKNOWN } } }
Dec 11 15:03:18 dist-test-slave-4k3m krb5kdc[13900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465397, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.190@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
I20251211 15:03:18.376307 14503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.368817 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:35081 (local address 127.0.0.1:56778)
1211 15:03:18.369154 (+   337us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:18.369175 (+    21us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:18.369288 (+   113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:18.369496 (+   208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:18.369499 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:18.369932 (+   433us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:18.370135 (+   203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.370142 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.370818 (+   676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.370821 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:18.371230 (+   409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.371238 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.371339 (+   101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.371931 (+   592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:18.371944 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:18.373318 (+  1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:18.374824 (+  1506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:18.374833 (+     9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:18.374839 (+     6us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:18.375179 (+   340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:18.375380 (+   201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:18.375383 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:18.375385 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:18.375426 (+    41us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:18.375745 (+   319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:18.375754 (+     9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:18.375850 (+    96us) client_negotiation.cc:769] Sending connection context
1211 15:03:18.375955 (+   105us) client_negotiation.cc:240] Negotiation successful
1211 15:03:18.376106 (+   151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":188,"threads_started":1}
I20251211 15:03:18.376305 13997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.368862 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56778 (local address 127.5.160.190:35081)
1211 15:03:18.369035 (+   173us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.369039 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.369246 (+   207us) server_negotiation.cc:408] Connection header received
1211 15:03:18.369369 (+   123us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.369372 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.369407 (+    35us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.369468 (+    61us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:18.370257 (+   789us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.370723 (+   466us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.371326 (+   603us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.371484 (+   158us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.373425 (+  1941us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:18.373441 (+    16us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:18.373443 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:18.373464 (+    21us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:18.374717 (+  1253us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:18.375266 (+   549us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:18.375269 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:18.375271 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:18.375308 (+    37us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:18.375506 (+   198us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:18.375509 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:18.375511 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:18.375654 (+   143us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:18.375734 (+    80us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.376010 (+   276us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.376171 (+   161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":93}
I20251211 15:03:18.380513 13948 catalog_manager.cc:2257] Servicing CreateTable request from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:56778:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20251211 15:03:18.381266 13948 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:03:18.385929 14229 tablet_service.cc:1505] Processing CreateTablet for tablet ed2e350ae429489a8aae42897c9c6b53 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2ac7691ade554b42b9147a0d4a5bc727]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20251211 15:03:18.385872 14087 tablet_service.cc:1505] Processing CreateTablet for tablet ed2e350ae429489a8aae42897c9c6b53 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2ac7691ade554b42b9147a0d4a5bc727]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20251211 15:03:18.386277 14087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2e350ae429489a8aae42897c9c6b53. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:18.386277 14229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2e350ae429489a8aae42897c9c6b53. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:18.386253 14371 tablet_service.cc:1505] Processing CreateTablet for tablet ed2e350ae429489a8aae42897c9c6b53 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2ac7691ade554b42b9147a0d4a5bc727]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20251211 15:03:18.386581 14371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2e350ae429489a8aae42897c9c6b53. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:18.388844 14465 tablet_bootstrap.cc:492] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7: Bootstrap starting.
I20251211 15:03:18.388867 14467 tablet_bootstrap.cc:492] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087: Bootstrap starting.
I20251211 15:03:18.389151 14466 tablet_bootstrap.cc:492] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4: Bootstrap starting.
I20251211 15:03:18.389851 14465 tablet_bootstrap.cc:654] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:18.389878 14467 tablet_bootstrap.cc:654] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:18.389981 14466 tablet_bootstrap.cc:654] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:18.391276 14467 tablet_bootstrap.cc:492] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087: No bootstrap required, opened a new log
I20251211 15:03:18.391273 14465 tablet_bootstrap.cc:492] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7: No bootstrap required, opened a new log
I20251211 15:03:18.391294 14466 tablet_bootstrap.cc:492] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4: No bootstrap required, opened a new log
I20251211 15:03:18.391360 14466 ts_tablet_manager.cc:1403] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:03:18.391361 14465 ts_tablet_manager.cc:1403] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20251211 15:03:18.391361 14467 ts_tablet_manager.cc:1403] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20251211 15:03:18.391806 14467 raft_consensus.cc:359] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.391813 14465 raft_consensus.cc:359] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.391813 14466 raft_consensus.cc:359] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.391907 14467 raft_consensus.cc:385] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:18.391916 14466 raft_consensus.cc:385] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:18.391916 14465 raft_consensus.cc:385] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:18.391937 14467 raft_consensus.cc:740] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cfc2aac65784a7cb858a53ad09c2087, State: Initialized, Role: FOLLOWER
I20251211 15:03:18.391948 14466 raft_consensus.cc:740] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3844f00bc7448949291a528b57e92b4, State: Initialized, Role: FOLLOWER
I20251211 15:03:18.391948 14465 raft_consensus.cc:740] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd32e8d91cb6468e84d61da64e6b09a7, State: Initialized, Role: FOLLOWER
I20251211 15:03:18.392067 14467 consensus_queue.cc:260] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.392077 14465 consensus_queue.cc:260] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.392073 14466 consensus_queue.cc:260] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.392328 14467 ts_tablet_manager.cc:1434] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20251211 15:03:18.392333 14465 ts_tablet_manager.cc:1434] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20251211 15:03:18.392333 14466 ts_tablet_manager.cc:1434] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20251211 15:03:18.392356 14473 tablet_replica.cc:442] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } } }
I20251211 15:03:18.392469 14473 tablet_replica.cc:445] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:03:18.392535 14489 tablet_replica.cc:442] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } } }
I20251211 15:03:18.392546 14472 tablet_replica.cc:442] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } } }
I20251211 15:03:18.392648 14472 tablet_replica.cc:445] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:03:18.392648 14489 tablet_replica.cc:445] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:03:18.643275 14472 raft_consensus.cc:493] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:03:18.643438 14472 raft_consensus.cc:515] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.644548 14472 leader_election.cc:290] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3844f00bc7448949291a528b57e92b4 (127.5.160.129:40277), 8cfc2aac65784a7cb858a53ad09c2087 (127.5.160.130:45303)
I20251211 15:03:18.647558 14507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.644823 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:45303 (local address 127.5.160.131:40399)
1211 15:03:18.645188 (+   365us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:18.645200 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:18.645338 (+   138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:18.645572 (+   234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:18.645576 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:18.645592 (+    16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:18.645810 (+   218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.645816 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.646545 (+   729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.646548 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:18.647149 (+   601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.647157 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.647267 (+   110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.647291 (+    24us) client_negotiation.cc:769] Sending connection context
1211 15:03:18.647339 (+    48us) client_negotiation.cc:240] Negotiation successful
1211 15:03:18.647400 (+    61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":151,"threads_started":1}
I20251211 15:03:18.647626 14508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.644832 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:40277 (local address 127.5.160.131:40319)
1211 15:03:18.645313 (+   481us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:18.645324 (+    11us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:18.645425 (+   101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:18.645650 (+   225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:18.645653 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:18.645668 (+    15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:18.645876 (+   208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.645882 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.646623 (+   741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.646627 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:18.647230 (+   603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.647239 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.647355 (+   116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.647375 (+    20us) client_negotiation.cc:769] Sending connection context
1211 15:03:18.647423 (+    48us) client_negotiation.cc:240] Negotiation successful
1211 15:03:18.647479 (+    56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":76,"threads_started":1}
I20251211 15:03:18.647984 14461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.645027 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:40399 (local address 127.5.160.130:45303)
1211 15:03:18.645137 (+   110us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.645141 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.645300 (+   159us) server_negotiation.cc:408] Connection header received
1211 15:03:18.645436 (+   136us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.645440 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.645485 (+    45us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.645549 (+    64us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:18.645917 (+   368us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.646433 (+   516us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.647264 (+   831us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.647700 (+   436us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.647742 (+    42us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.647795 (+    53us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.647855 (+    60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20251211 15:03:18.648020 14463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.644923 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:40319 (local address 127.5.160.129:40277)
1211 15:03:18.645068 (+   145us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.645072 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.645405 (+   333us) server_negotiation.cc:408] Connection header received
1211 15:03:18.645520 (+   115us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.645523 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.645566 (+    43us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.645626 (+    60us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:18.646035 (+   409us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.646517 (+   482us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.647339 (+   822us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.647767 (+   428us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.647804 (+    37us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.647856 (+    52us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.647916 (+    60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20251211 15:03:18.648378 14249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed2e350ae429489a8aae42897c9c6b53" candidate_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cfc2aac65784a7cb858a53ad09c2087" is_pre_election: true
I20251211 15:03:18.648540 14249 raft_consensus.cc:2468] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd32e8d91cb6468e84d61da64e6b09a7 in term 0.
I20251211 15:03:18.648505 14107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed2e350ae429489a8aae42897c9c6b53" candidate_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3844f00bc7448949291a528b57e92b4" is_pre_election: true
I20251211 15:03:18.648694 14107 raft_consensus.cc:2468] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd32e8d91cb6468e84d61da64e6b09a7 in term 0.
I20251211 15:03:18.648913 14322 leader_election.cc:304] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cfc2aac65784a7cb858a53ad09c2087, bd32e8d91cb6468e84d61da64e6b09a7; no voters: 
I20251211 15:03:18.649164 14472 raft_consensus.cc:2804] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:03:18.649256 14472 raft_consensus.cc:493] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:03:18.649305 14472 raft_consensus.cc:3060] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:18.650161 14472 raft_consensus.cc:515] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.650491 14472 leader_election.cc:290] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [CANDIDATE]: Term 1 election: Requested vote from peers f3844f00bc7448949291a528b57e92b4 (127.5.160.129:40277), 8cfc2aac65784a7cb858a53ad09c2087 (127.5.160.130:45303)
I20251211 15:03:18.650853 14107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed2e350ae429489a8aae42897c9c6b53" candidate_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3844f00bc7448949291a528b57e92b4"
I20251211 15:03:18.650853 14249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed2e350ae429489a8aae42897c9c6b53" candidate_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cfc2aac65784a7cb858a53ad09c2087"
I20251211 15:03:18.651005 14107 raft_consensus.cc:3060] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:18.651044 14249 raft_consensus.cc:3060] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:18.652069 14249 raft_consensus.cc:2468] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd32e8d91cb6468e84d61da64e6b09a7 in term 1.
I20251211 15:03:18.652069 14107 raft_consensus.cc:2468] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd32e8d91cb6468e84d61da64e6b09a7 in term 1.
I20251211 15:03:18.652362 14322 leader_election.cc:304] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cfc2aac65784a7cb858a53ad09c2087, bd32e8d91cb6468e84d61da64e6b09a7; no voters: 
I20251211 15:03:18.652510 14472 raft_consensus.cc:2804] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:18.652680 14472 raft_consensus.cc:697] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 LEADER]: Becoming Leader. State: Replica: bd32e8d91cb6468e84d61da64e6b09a7, State: Running, Role: LEADER
I20251211 15:03:18.652926 14472 consensus_queue.cc:237] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.654132 14509 tablet_replica.cc:442] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7: TxnStatusTablet state changed. Reason: New leader bd32e8d91cb6468e84d61da64e6b09a7. Latest consensus state: current_term: 1 leader_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } } }
I20251211 15:03:18.654237 14509 tablet_replica.cc:445] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7: This TxnStatusTablet replica's current role is: LEADER
I20251211 15:03:18.654464 14511 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20251211 15:03:18.654593 14511 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20251211 15:03:18.655514 13945 catalog_manager.cc:5654] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd32e8d91cb6468e84d61da64e6b09a7 (127.5.160.131). New cstate: current_term: 1 leader_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } health_report { overall_health: HEALTHY } } }
I20251211 15:03:18.693181 14514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.689630 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34880 (local address 127.5.160.131:32929)
1211 15:03:18.689862 (+   232us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.689866 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.689880 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:03:18.690114 (+   234us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.690117 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.690186 (+    69us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.690277 (+    91us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:03:18.690709 (+   432us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.691382 (+   673us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.692070 (+   688us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.692256 (+   186us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.692316 (+    60us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:03:18.692760 (+   444us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:03:18.692864 (+   104us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.692959 (+    95us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.693014 (+    55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":59,"threads_started":1}
I20251211 15:03:18.693167 14503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.689541 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:32929 (local address 127.0.0.1:34880)
1211 15:03:18.689807 (+   266us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:18.689822 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:18.689938 (+   116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:18.690297 (+   359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:18.690301 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:18.690309 (+     8us) client_negotiation.cc:189] Negotiated authn=TOKEN
1211 15:03:18.690563 (+   254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.690570 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.691505 (+   935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.691509 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:18.691957 (+   448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.691966 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.692076 (+   110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.692131 (+    55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
1211 15:03:18.692860 (+   729us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
1211 15:03:18.692878 (+    18us) client_negotiation.cc:769] Sending connection context
1211 15:03:18.692941 (+    63us) client_negotiation.cc:240] Negotiation successful
1211 15:03:18.693037 (+    96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142}
I20251211 15:03:18.696465 14249 raft_consensus.cc:1275] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Refusing update from remote peer bd32e8d91cb6468e84d61da64e6b09a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:03:18.696655 14107 raft_consensus.cc:1275] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4 [term 1 FOLLOWER]: Refusing update from remote peer bd32e8d91cb6468e84d61da64e6b09a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:03:18.696959 14472 consensus_queue.cc:1048] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:18.697113 14509 consensus_queue.cc:1048] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:18.698740 14473 tablet_replica.cc:442] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087: TxnStatusTablet state changed. Reason: New leader bd32e8d91cb6468e84d61da64e6b09a7. Latest consensus state: current_term: 1 leader_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } } }
I20251211 15:03:18.698859 14473 tablet_replica.cc:445] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:03:18.699182 14489 tablet_replica.cc:442] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4: TxnStatusTablet state changed. Reason: New leader bd32e8d91cb6468e84d61da64e6b09a7. Latest consensus state: current_term: 1 leader_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } } }
I20251211 15:03:18.699290 14489 tablet_replica.cc:445] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:03:18.701201 14472 tablet_replica.cc:442] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } } }
I20251211 15:03:18.701315 14472 tablet_replica.cc:445] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7: This TxnStatusTablet replica's current role is: LEADER
I20251211 15:03:18.701781 14489 tablet_replica.cc:442] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } } }
I20251211 15:03:18.701889 14489 tablet_replica.cc:445] T ed2e350ae429489a8aae42897c9c6b53 P f3844f00bc7448949291a528b57e92b4: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:03:18.703823 14518 mvcc.cc:204] Tried to move back new op lower bound from 7231346273055277056 to 7231346272885035008. Current Snapshot: MvccSnapshot[applied={T|T < 7231346273055277056}]
I20251211 15:03:18.712486 14509 tablet_replica.cc:442] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } } }
I20251211 15:03:18.712641 14509 tablet_replica.cc:445] T ed2e350ae429489a8aae42897c9c6b53 P bd32e8d91cb6468e84d61da64e6b09a7: This TxnStatusTablet replica's current role is: LEADER
I20251211 15:03:18.712986 14489 consensus_queue.cc:1048] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:18.713987 14473 tablet_replica.cc:442] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } } }
I20251211 15:03:18.714107 14473 tablet_replica.cc:445] T ed2e350ae429489a8aae42897c9c6b53 P 8cfc2aac65784a7cb858a53ad09c2087: This TxnStatusTablet replica's current role is: FOLLOWER
I20251211 15:03:18.718261 14514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.715047 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:48611 (local address 127.5.160.131:32929)
1211 15:03:18.715164 (+   117us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.715168 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.715181 (+    13us) server_negotiation.cc:408] Connection header received
1211 15:03:18.715217 (+    36us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.715220 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.715262 (+    42us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.715325 (+    63us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:03:18.715740 (+   415us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.716567 (+   827us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.717476 (+   909us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.717682 (+   206us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.717730 (+    48us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:03:18.717819 (+    89us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:03:18.717899 (+    80us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.718045 (+   146us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.718111 (+    66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20251211 15:03:18.718632 14525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.714534 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:32929 (local address 127.5.160.129:48611)
1211 15:03:18.714957 (+   423us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:18.714973 (+    16us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:18.715081 (+   108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:18.715351 (+   270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:18.715354 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:18.715363 (+     9us) client_negotiation.cc:189] Negotiated authn=TOKEN
1211 15:03:18.715602 (+   239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.715610 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.716702 (+  1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.716705 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:18.717298 (+   593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.717309 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.717439 (+   130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.717498 (+    59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
1211 15:03:18.717945 (+   447us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
1211 15:03:18.717952 (+     7us) client_negotiation.cc:769] Sending connection context
1211 15:03:18.718410 (+   458us) client_negotiation.cc:240] Negotiation successful
1211 15:03:18.718501 (+    91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":201,"threads_started":1}
I20251211 15:03:18.722440 14484 consensus_queue.cc:1048] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:18.752100 14463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.749022 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:41657 (local address 127.5.160.129:40277)
1211 15:03:18.749152 (+   130us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.749157 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.749171 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:03:18.749302 (+   131us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.749304 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.749351 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.749412 (+    61us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:03:18.749848 (+   436us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.750418 (+   570us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.751451 (+  1033us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.751632 (+   181us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.751674 (+    42us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:03:18.751751 (+    77us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:03:18.751812 (+    61us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.751905 (+    93us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.751956 (+    51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20251211 15:03:18.752118 14531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.748721 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:40277 (local address 127.5.160.131:41657)
1211 15:03:18.749081 (+   360us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:18.749098 (+    17us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:18.749200 (+   102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:18.749433 (+   233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:18.749436 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:18.749444 (+     8us) client_negotiation.cc:189] Negotiated authn=TOKEN
1211 15:03:18.749729 (+   285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.749737 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.750722 (+   985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.750724 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:18.751336 (+   612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:18.751345 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.751441 (+    96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.751492 (+    51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
1211 15:03:18.751834 (+   342us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
1211 15:03:18.751840 (+     6us) client_negotiation.cc:769] Sending connection context
1211 15:03:18.751898 (+    58us) client_negotiation.cc:240] Negotiation successful
1211 15:03:18.751983 (+    85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":110,"threads_started":1}
I20251211 15:03:18.777305 13945 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56772:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:03:18.777458 13945 catalog_manager.cc:2755] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56772:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:03:18.779675 13945 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef: Sending DeleteTablet for 3 replicas of tablet 6deaa43f096f47859184fbe3f31d4cc8
I20251211 15:03:18.780390 14229 tablet_service.cc:1552] Processing DeleteTablet for tablet 6deaa43f096f47859184fbe3f31d4cc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:18 UTC) from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:46286
I20251211 15:03:18.780709 14371 tablet_service.cc:1552] Processing DeleteTablet for tablet 6deaa43f096f47859184fbe3f31d4cc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:18 UTC) from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:34874
I20251211 15:03:18.780973 14534 tablet_replica.cc:333] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087: stopping tablet replica
I20251211 15:03:18.781133 14534 raft_consensus.cc:2243] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:03:18.781517 14534 raft_consensus.cc:2272] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:18.782564 14087 tablet_service.cc:1552] Processing DeleteTablet for tablet 6deaa43f096f47859184fbe3f31d4cc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:18 UTC) from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:48606
I20251211 15:03:18.783003 14535 tablet_replica.cc:333] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7: stopping tablet replica
I20251211 15:03:18.783142 14535 raft_consensus.cc:2243] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:03:18.783280 14535 raft_consensus.cc:2272] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:18.784415 14534 ts_tablet_manager.cc:1916] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:18.786589 14535 ts_tablet_manager.cc:1916] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:18.787112 14534 ts_tablet_manager.cc:1929] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20251211 15:03:18.787204 14534 log.cc:1199] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/wal/wals/6deaa43f096f47859184fbe3f31d4cc8
I20251211 15:03:18.787442 14534 ts_tablet_manager.cc:1950] T 6deaa43f096f47859184fbe3f31d4cc8 P 8cfc2aac65784a7cb858a53ad09c2087: Deleting consensus metadata
I20251211 15:03:18.788239 13932 catalog_manager.cc:4985] TS 8cfc2aac65784a7cb858a53ad09c2087 (127.5.160.130:45303): tablet 6deaa43f096f47859184fbe3f31d4cc8 (table test-table [id=2a6d2f10bff64f02aecb86edad6514f2]) successfully deleted
I20251211 15:03:18.788627 14537 tablet_replica.cc:333] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4: stopping tablet replica
I20251211 15:03:18.788770 14537 raft_consensus.cc:2243] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [term 1 LEADER]: Raft consensus shutting down.
I20251211 15:03:18.789003 14537 raft_consensus.cc:2272] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:18.789266 14535 ts_tablet_manager.cc:1929] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20251211 15:03:18.789348 14535 log.cc:1199] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/wal/wals/6deaa43f096f47859184fbe3f31d4cc8
I20251211 15:03:18.789618 14535 ts_tablet_manager.cc:1950] T 6deaa43f096f47859184fbe3f31d4cc8 P bd32e8d91cb6468e84d61da64e6b09a7: Deleting consensus metadata
I20251211 15:03:18.789700 14537 ts_tablet_manager.cc:1916] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:18.790371 13933 catalog_manager.cc:4985] TS bd32e8d91cb6468e84d61da64e6b09a7 (127.5.160.131:32929): tablet 6deaa43f096f47859184fbe3f31d4cc8 (table test-table [id=2a6d2f10bff64f02aecb86edad6514f2]) successfully deleted
I20251211 15:03:18.792585 14537 ts_tablet_manager.cc:1929] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20251211 15:03:18.792673 14537 log.cc:1199] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/wal/wals/6deaa43f096f47859184fbe3f31d4cc8
I20251211 15:03:18.792943 14537 ts_tablet_manager.cc:1950] T 6deaa43f096f47859184fbe3f31d4cc8 P f3844f00bc7448949291a528b57e92b4: Deleting consensus metadata
I20251211 15:03:18.793774 13933 catalog_manager.cc:4985] TS f3844f00bc7448949291a528b57e92b4 (127.5.160.129:40277): tablet 6deaa43f096f47859184fbe3f31d4cc8 (table test-table [id=2a6d2f10bff64f02aecb86edad6514f2]) successfully deleted
Dec 11 15:03:18 dist-test-slave-4k3m krb5kdc[13900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465398, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
Dec 11 15:03:18 dist-test-slave-4k3m krb5kdc[13900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:18 dist-test-slave-4k3m krb5kdc[13900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
W20251211 15:03:18.810961 13997 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:18.803712 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56792 (local address 127.5.160.190:35081)
1211 15:03:18.803853 (+   141us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.803858 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.804064 (+   206us) server_negotiation.cc:408] Connection header received
1211 15:03:18.804204 (+   140us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.804208 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.804268 (+    60us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.804371 (+   103us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:18.805426 (+  1055us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.806226 (+   800us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.807219 (+   993us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.807435 (+   216us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.810758 (+  3323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56792: BlockingRecv error: recv got EOF from 127.0.0.1:56792 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Dec 11 15:03:18 dist-test-slave-4k3m krb5kdc[13900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465398, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM
I20251211 15:03:18.821687 13997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.812482 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56798 (local address 127.5.160.190:35081)
1211 15:03:18.812644 (+   162us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.812649 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.812941 (+   292us) server_negotiation.cc:408] Connection header received
1211 15:03:18.813073 (+   132us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.813076 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.813137 (+    61us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.813231 (+    94us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:18.814086 (+   855us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.814854 (+   768us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.815814 (+   960us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.816014 (+   200us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.818201 (+  2187us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:18.818229 (+    28us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:18.818232 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:18.818270 (+    38us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:18.820125 (+  1855us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:18.820563 (+   438us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:18.820567 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:18.820569 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:18.820629 (+    60us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:18.820840 (+   211us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:18.820843 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:18.820845 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:18.821054 (+   209us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:18.821203 (+   149us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.821391 (+   188us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.821513 (+   122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20251211 15:03:18.824508 13945 catalog_manager.cc:2257] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56798:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20251211 15:03:18.825044 13945 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:03:18.830404 14087 tablet_service.cc:1505] Processing CreateTablet for tablet c7f55dae57494410990a1d1096ec2b55 (DEFAULT_TABLE table=test-table [id=3c6f0e88f9c64d008aba611fa923d7c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:18.830763 14087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f55dae57494410990a1d1096ec2b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:18.830715 14371 tablet_service.cc:1505] Processing CreateTablet for tablet c7f55dae57494410990a1d1096ec2b55 (DEFAULT_TABLE table=test-table [id=3c6f0e88f9c64d008aba611fa923d7c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:18.831051 14371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f55dae57494410990a1d1096ec2b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:18.831393 14229 tablet_service.cc:1505] Processing CreateTablet for tablet c7f55dae57494410990a1d1096ec2b55 (DEFAULT_TABLE table=test-table [id=3c6f0e88f9c64d008aba611fa923d7c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:18.831643 14229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f55dae57494410990a1d1096ec2b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:18.832948 14465 tablet_bootstrap.cc:492] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7: Bootstrap starting.
I20251211 15:03:18.833725 14467 tablet_bootstrap.cc:492] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087: Bootstrap starting.
I20251211 15:03:18.833832 14465 tablet_bootstrap.cc:654] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:18.834553 14467 tablet_bootstrap.cc:654] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:18.835249 14465 tablet_bootstrap.cc:492] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7: No bootstrap required, opened a new log
I20251211 15:03:18.835328 14465 ts_tablet_manager.cc:1403] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:18.835820 14465 raft_consensus.cc:359] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.835949 14465 raft_consensus.cc:385] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:18.835984 14465 raft_consensus.cc:740] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd32e8d91cb6468e84d61da64e6b09a7, State: Initialized, Role: FOLLOWER
I20251211 15:03:18.836104 14465 consensus_queue.cc:260] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.836351 14466 tablet_bootstrap.cc:492] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4: Bootstrap starting.
I20251211 15:03:18.836359 14465 ts_tablet_manager.cc:1434] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20251211 15:03:18.837293 14466 tablet_bootstrap.cc:654] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:18.838354 14466 tablet_bootstrap.cc:492] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4: No bootstrap required, opened a new log
I20251211 15:03:18.838389 14467 tablet_bootstrap.cc:492] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087: No bootstrap required, opened a new log
I20251211 15:03:18.838454 14466 ts_tablet_manager.cc:1403] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.002s
I20251211 15:03:18.838469 14467 ts_tablet_manager.cc:1403] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.001s
I20251211 15:03:18.838869 14466 raft_consensus.cc:359] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.838917 14467 raft_consensus.cc:359] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.839023 14466 raft_consensus.cc:385] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:18.839051 14467 raft_consensus.cc:385] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:18.839057 14466 raft_consensus.cc:740] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3844f00bc7448949291a528b57e92b4, State: Initialized, Role: FOLLOWER
I20251211 15:03:18.839078 14467 raft_consensus.cc:740] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cfc2aac65784a7cb858a53ad09c2087, State: Initialized, Role: FOLLOWER
I20251211 15:03:18.839179 14466 consensus_queue.cc:260] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.839231 14467 consensus_queue.cc:260] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.839445 14466 ts_tablet_manager.cc:1434] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20251211 15:03:18.839479 14467 ts_tablet_manager.cc:1434] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20251211 15:03:18.933745 14484 raft_consensus.cc:493] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:03:18.933892 14484 raft_consensus.cc:515] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.934363 14484 leader_election.cc:290] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cfc2aac65784a7cb858a53ad09c2087 (127.5.160.130:45303), bd32e8d91cb6468e84d61da64e6b09a7 (127.5.160.131:32929)
I20251211 15:03:18.934904 14391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7f55dae57494410990a1d1096ec2b55" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" is_pre_election: true
I20251211 15:03:18.934960 14248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7f55dae57494410990a1d1096ec2b55" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cfc2aac65784a7cb858a53ad09c2087" is_pre_election: true
I20251211 15:03:18.935098 14391 raft_consensus.cc:2468] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 0.
I20251211 15:03:18.935098 14248 raft_consensus.cc:2468] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 0.
I20251211 15:03:18.935500 14038 leader_election.cc:304] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cfc2aac65784a7cb858a53ad09c2087, f3844f00bc7448949291a528b57e92b4; no voters: 
I20251211 15:03:18.935704 14484 raft_consensus.cc:2804] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:03:18.935774 14484 raft_consensus.cc:493] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:03:18.935817 14484 raft_consensus.cc:3060] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:18.936941 14484 raft_consensus.cc:515] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.937294 14484 leader_election.cc:290] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 election: Requested vote from peers 8cfc2aac65784a7cb858a53ad09c2087 (127.5.160.130:45303), bd32e8d91cb6468e84d61da64e6b09a7 (127.5.160.131:32929)
I20251211 15:03:18.937709 14391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7f55dae57494410990a1d1096ec2b55" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd32e8d91cb6468e84d61da64e6b09a7"
I20251211 15:03:18.937868 14248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7f55dae57494410990a1d1096ec2b55" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cfc2aac65784a7cb858a53ad09c2087"
I20251211 15:03:18.937848 14391 raft_consensus.cc:3060] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:18.937996 14248 raft_consensus.cc:3060] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:18.939173 14391 raft_consensus.cc:2468] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 1.
I20251211 15:03:18.939520 14039 leader_election.cc:304] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd32e8d91cb6468e84d61da64e6b09a7, f3844f00bc7448949291a528b57e92b4; no voters: 
I20251211 15:03:18.939565 14248 raft_consensus.cc:2468] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 1.
I20251211 15:03:18.939700 14484 raft_consensus.cc:2804] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:18.939909 14484 raft_consensus.cc:697] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [term 1 LEADER]: Becoming Leader. State: Replica: f3844f00bc7448949291a528b57e92b4, State: Running, Role: LEADER
I20251211 15:03:18.940061 14484 consensus_queue.cc:237] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.941720 13945 catalog_manager.cc:5654] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3844f00bc7448949291a528b57e92b4 (127.5.160.129). New cstate: current_term: 1 leader_uuid: "f3844f00bc7448949291a528b57e92b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20251211 15:03:18.966770 14463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:18.964382 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48616 (local address 127.5.160.129:40277)
1211 15:03:18.964522 (+   140us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:18.964526 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:18.964540 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:03:18.964617 (+    77us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:18.964619 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:18.964673 (+    54us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:18.964737 (+    64us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:03:18.965039 (+   302us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.965515 (+   476us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:18.966135 (+   620us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:18.966277 (+   142us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:18.966315 (+    38us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:03:18.966382 (+    67us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:03:18.966435 (+    53us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:18.966558 (+   123us) server_negotiation.cc:300] Negotiation successful
1211 15:03:18.966623 (+    65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20251211 15:03:18.968765 14248 raft_consensus.cc:1275] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Refusing update from remote peer f3844f00bc7448949291a528b57e92b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:03:18.968765 14391 raft_consensus.cc:1275] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Refusing update from remote peer f3844f00bc7448949291a528b57e92b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:03:18.969209 14484 consensus_queue.cc:1048] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:18.969355 14489 consensus_queue.cc:1048] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:18.976601 13948 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56798:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:03:18.976737 13948 catalog_manager.cc:2755] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56798:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:03:18.978649 13948 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef: Sending DeleteTablet for 3 replicas of tablet c7f55dae57494410990a1d1096ec2b55
I20251211 15:03:18.979326 14371 tablet_service.cc:1552] Processing DeleteTablet for tablet c7f55dae57494410990a1d1096ec2b55 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:18 UTC) from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:34874
I20251211 15:03:18.979319 14229 tablet_service.cc:1552] Processing DeleteTablet for tablet c7f55dae57494410990a1d1096ec2b55 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:18 UTC) from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:46286
I20251211 15:03:18.979322 14087 tablet_service.cc:1552] Processing DeleteTablet for tablet c7f55dae57494410990a1d1096ec2b55 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:18 UTC) from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:48606
I20251211 15:03:18.979545 14534 tablet_replica.cc:333] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087: stopping tablet replica
I20251211 15:03:18.979676 14534 raft_consensus.cc:2243] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:03:18.979804 14534 raft_consensus.cc:2272] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:18.979981 14537 tablet_replica.cc:333] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4: stopping tablet replica
I20251211 15:03:18.980106 14537 raft_consensus.cc:2243] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [term 1 LEADER]: Raft consensus shutting down.
I20251211 15:03:18.980341 14537 raft_consensus.cc:2272] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:18.980538 14535 tablet_replica.cc:333] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7: stopping tablet replica
I20251211 15:03:18.980527 14534 ts_tablet_manager.cc:1916] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:18.980650 14535 raft_consensus.cc:2243] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:03:18.980772 14535 raft_consensus.cc:2272] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:18.980990 14537 ts_tablet_manager.cc:1916] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:18.981479 14535 ts_tablet_manager.cc:1916] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:18.981745 13948 catalog_manager.cc:2257] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56798:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20251211 15:03:18.982223 13948 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:03:18.982959 14534 ts_tablet_manager.cc:1929] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:03:18.983026 14534 log.cc:1199] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/wal/wals/c7f55dae57494410990a1d1096ec2b55
I20251211 15:03:18.983253 14534 ts_tablet_manager.cc:1950] T c7f55dae57494410990a1d1096ec2b55 P 8cfc2aac65784a7cb858a53ad09c2087: Deleting consensus metadata
I20251211 15:03:18.983377 14537 ts_tablet_manager.cc:1929] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:03:18.983438 14537 log.cc:1199] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-0/wal/wals/c7f55dae57494410990a1d1096ec2b55
I20251211 15:03:18.983675 14537 ts_tablet_manager.cc:1950] T c7f55dae57494410990a1d1096ec2b55 P f3844f00bc7448949291a528b57e92b4: Deleting consensus metadata
I20251211 15:03:18.984081 14535 ts_tablet_manager.cc:1929] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:03:18.984145 14535 log.cc:1199] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/wal/wals/c7f55dae57494410990a1d1096ec2b55
I20251211 15:03:18.984361 14535 ts_tablet_manager.cc:1950] T c7f55dae57494410990a1d1096ec2b55 P bd32e8d91cb6468e84d61da64e6b09a7: Deleting consensus metadata
I20251211 15:03:18.984536 13933 catalog_manager.cc:4985] TS f3844f00bc7448949291a528b57e92b4 (127.5.160.129:40277): tablet c7f55dae57494410990a1d1096ec2b55 (table test-table [id=3c6f0e88f9c64d008aba611fa923d7c2]) successfully deleted
I20251211 15:03:18.984619 13932 catalog_manager.cc:4985] TS 8cfc2aac65784a7cb858a53ad09c2087 (127.5.160.130:45303): tablet c7f55dae57494410990a1d1096ec2b55 (table test-table [id=3c6f0e88f9c64d008aba611fa923d7c2]) successfully deleted
I20251211 15:03:18.985749 13933 catalog_manager.cc:4985] TS bd32e8d91cb6468e84d61da64e6b09a7 (127.5.160.131:32929): tablet c7f55dae57494410990a1d1096ec2b55 (table test-table [id=3c6f0e88f9c64d008aba611fa923d7c2]) successfully deleted
I20251211 15:03:18.987762 14087 tablet_service.cc:1505] Processing CreateTablet for tablet 2c3b26d2f5144a69a4335b12a8e6bbce (DEFAULT_TABLE table=test-table [id=0807112e168645c9945da4dfdcfd4ec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:18.988065 14087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c3b26d2f5144a69a4335b12a8e6bbce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:18.988087 14371 tablet_service.cc:1505] Processing CreateTablet for tablet 2c3b26d2f5144a69a4335b12a8e6bbce (DEFAULT_TABLE table=test-table [id=0807112e168645c9945da4dfdcfd4ec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:18.988348 14371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c3b26d2f5144a69a4335b12a8e6bbce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:18.990207 14466 tablet_bootstrap.cc:492] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4: Bootstrap starting.
I20251211 15:03:18.990376 14465 tablet_bootstrap.cc:492] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7: Bootstrap starting.
I20251211 15:03:18.990582 14229 tablet_service.cc:1505] Processing CreateTablet for tablet 2c3b26d2f5144a69a4335b12a8e6bbce (DEFAULT_TABLE table=test-table [id=0807112e168645c9945da4dfdcfd4ec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:18.990839 14229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c3b26d2f5144a69a4335b12a8e6bbce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:18.991150 14466 tablet_bootstrap.cc:654] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:18.991168 14465 tablet_bootstrap.cc:654] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:18.992580 14465 tablet_bootstrap.cc:492] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7: No bootstrap required, opened a new log
I20251211 15:03:18.992677 14465 ts_tablet_manager.cc:1403] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:03:18.992744 14466 tablet_bootstrap.cc:492] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4: No bootstrap required, opened a new log
I20251211 15:03:18.992818 14466 ts_tablet_manager.cc:1403] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4: Time spent bootstrapping tablet: real 0.003s	user 0.000s	sys 0.001s
I20251211 15:03:18.992815 14467 tablet_bootstrap.cc:492] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087: Bootstrap starting.
I20251211 15:03:18.993117 14465 raft_consensus.cc:359] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.993238 14465 raft_consensus.cc:385] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:18.993212 14466 raft_consensus.cc:359] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.993269 14465 raft_consensus.cc:740] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd32e8d91cb6468e84d61da64e6b09a7, State: Initialized, Role: FOLLOWER
I20251211 15:03:18.993301 14466 raft_consensus.cc:385] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:18.993328 14466 raft_consensus.cc:740] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3844f00bc7448949291a528b57e92b4, State: Initialized, Role: FOLLOWER
I20251211 15:03:18.993417 14465 consensus_queue.cc:260] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.993439 14466 consensus_queue.cc:260] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.993677 14466 ts_tablet_manager.cc:1434] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20251211 15:03:18.993703 14465 ts_tablet_manager.cc:1434] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20251211 15:03:18.993753 14467 tablet_bootstrap.cc:654] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:18.995127 14467 tablet_bootstrap.cc:492] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087: No bootstrap required, opened a new log
I20251211 15:03:18.995240 14467 ts_tablet_manager.cc:1403] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.002s
I20251211 15:03:18.995735 14467 raft_consensus.cc:359] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.995854 14467 raft_consensus.cc:385] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:18.995890 14467 raft_consensus.cc:740] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cfc2aac65784a7cb858a53ad09c2087, State: Initialized, Role: FOLLOWER
I20251211 15:03:18.996031 14467 consensus_queue.cc:260] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:18.996436 14467 ts_tablet_manager.cc:1434] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20251211 15:03:19.094183 14489 raft_consensus.cc:493] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:03:19.094355 14489 raft_consensus.cc:515] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:19.094786 14489 leader_election.cc:290] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cfc2aac65784a7cb858a53ad09c2087 (127.5.160.130:45303), bd32e8d91cb6468e84d61da64e6b09a7 (127.5.160.131:32929)
I20251211 15:03:19.095320 14248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3b26d2f5144a69a4335b12a8e6bbce" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cfc2aac65784a7cb858a53ad09c2087" is_pre_election: true
I20251211 15:03:19.095320 14391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3b26d2f5144a69a4335b12a8e6bbce" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" is_pre_election: true
I20251211 15:03:19.095477 14248 raft_consensus.cc:2468] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 0.
I20251211 15:03:19.095477 14391 raft_consensus.cc:2468] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 0.
I20251211 15:03:19.095789 14038 leader_election.cc:304] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cfc2aac65784a7cb858a53ad09c2087, f3844f00bc7448949291a528b57e92b4; no voters: 
I20251211 15:03:19.095988 14489 raft_consensus.cc:2804] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:03:19.096091 14489 raft_consensus.cc:493] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:03:19.096122 14489 raft_consensus.cc:3060] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:19.097048 14489 raft_consensus.cc:515] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:19.097422 14489 leader_election.cc:290] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 election: Requested vote from peers 8cfc2aac65784a7cb858a53ad09c2087 (127.5.160.130:45303), bd32e8d91cb6468e84d61da64e6b09a7 (127.5.160.131:32929)
I20251211 15:03:19.097838 14391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3b26d2f5144a69a4335b12a8e6bbce" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd32e8d91cb6468e84d61da64e6b09a7"
I20251211 15:03:19.097826 14248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3b26d2f5144a69a4335b12a8e6bbce" candidate_uuid: "f3844f00bc7448949291a528b57e92b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cfc2aac65784a7cb858a53ad09c2087"
I20251211 15:03:19.097957 14248 raft_consensus.cc:3060] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:19.097957 14391 raft_consensus.cc:3060] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:19.099045 14248 raft_consensus.cc:2468] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 1.
I20251211 15:03:19.099061 14391 raft_consensus.cc:2468] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3844f00bc7448949291a528b57e92b4 in term 1.
I20251211 15:03:19.099390 14038 leader_election.cc:304] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cfc2aac65784a7cb858a53ad09c2087, f3844f00bc7448949291a528b57e92b4; no voters: 
I20251211 15:03:19.099578 14489 raft_consensus.cc:2804] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:19.099689 14489 raft_consensus.cc:697] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [term 1 LEADER]: Becoming Leader. State: Replica: f3844f00bc7448949291a528b57e92b4, State: Running, Role: LEADER
I20251211 15:03:19.099841 14489 consensus_queue.cc:237] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } }
I20251211 15:03:19.101616 13946 catalog_manager.cc:5654] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3844f00bc7448949291a528b57e92b4 (127.5.160.129). New cstate: current_term: 1 leader_uuid: "f3844f00bc7448949291a528b57e92b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3844f00bc7448949291a528b57e92b4" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 } health_report { overall_health: UNKNOWN } } }
I20251211 15:03:19.131150 14248 raft_consensus.cc:1275] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Refusing update from remote peer f3844f00bc7448949291a528b57e92b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:03:19.131150 14391 raft_consensus.cc:1275] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Refusing update from remote peer f3844f00bc7448949291a528b57e92b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:03:19.131554 14533 consensus_queue.cc:1048] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cfc2aac65784a7cb858a53ad09c2087" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 45303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:19.131726 14489 consensus_queue.cc:1048] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd32e8d91cb6468e84d61da64e6b09a7" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 32929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:19.165593 13948 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56798:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:03:19.165738 13948 catalog_manager.cc:2755] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56798:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:03:19.167788 13948 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 0eb5ffd1cc03441f8e8ee25066f4d2ef: Sending DeleteTablet for 3 replicas of tablet 2c3b26d2f5144a69a4335b12a8e6bbce
I20251211 15:03:19.168370 14087 tablet_service.cc:1552] Processing DeleteTablet for tablet 2c3b26d2f5144a69a4335b12a8e6bbce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:19 UTC) from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:48606
I20251211 15:03:19.168572 14537 tablet_replica.cc:333] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4: stopping tablet replica
I20251211 15:03:19.168577 14371 tablet_service.cc:1552] Processing DeleteTablet for tablet 2c3b26d2f5144a69a4335b12a8e6bbce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:19 UTC) from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:34874
I20251211 15:03:19.168690 14537 raft_consensus.cc:2243] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [term 1 LEADER]: Raft consensus shutting down.
I20251211 15:03:19.168886 14537 raft_consensus.cc:2272] T 2c3b26d2f5144a69a4335b12a8e6bbce P f3844f00bc7448949291a528b57e92b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:19.169080  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 14022
I20251211 15:03:19.170395 14229 tablet_service.cc:1552] Processing DeleteTablet for tablet 2c3b26d2f5144a69a4335b12a8e6bbce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:19 UTC) from {username='oryx', principal='oryx/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:46286
I20251211 15:03:19.170601 14534 tablet_replica.cc:333] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087: stopping tablet replica
I20251211 15:03:19.170666 14535 tablet_replica.cc:333] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7: stopping tablet replica
I20251211 15:03:19.170724 14534 raft_consensus.cc:2243] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:03:19.170778 14535 raft_consensus.cc:2243] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:03:19.170851 14534 raft_consensus.cc:2272] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:19.170915 14535 raft_consensus.cc:2272] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:19.171646 14534 ts_tablet_manager.cc:1916] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:19.173543 14534 ts_tablet_manager.cc:1929] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20251211 15:03:19.173626 14534 log.cc:1199] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-1/wal/wals/2c3b26d2f5144a69a4335b12a8e6bbce
I20251211 15:03:19.173857 14534 ts_tablet_manager.cc:1950] T 2c3b26d2f5144a69a4335b12a8e6bbce P 8cfc2aac65784a7cb858a53ad09c2087: Deleting consensus metadata
I20251211 15:03:19.174222 14535 ts_tablet_manager.cc:1916] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:19.174551 13932 catalog_manager.cc:4985] TS 8cfc2aac65784a7cb858a53ad09c2087 (127.5.160.130:45303): tablet 2c3b26d2f5144a69a4335b12a8e6bbce (table test-table [id=0807112e168645c9945da4dfdcfd4ec4]) successfully deleted
I20251211 15:03:19.176795 14535 ts_tablet_manager.cc:1929] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
W20251211 15:03:19.176775 13933 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.160.129:40277 (error 108)
I20251211 15:03:19.176879 14535 log.cc:1199] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1765465326787564-5762-0/minicluster-data/ts-2/wal/wals/2c3b26d2f5144a69a4335b12a8e6bbce
I20251211 15:03:19.177073  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 14164
I20251211 15:03:19.177101 14535 ts_tablet_manager.cc:1950] T 2c3b26d2f5144a69a4335b12a8e6bbce P bd32e8d91cb6468e84d61da64e6b09a7: Deleting consensus metadata
I20251211 15:03:19.178787 14563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:19.178371 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:40277 (local address 127.0.0.1:48626)
1211 15:03:19.178602 (+   231us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:19.178674 (+    72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.129:40277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":61,"threads_started":1}
W20251211 15:03:19.178920 13933 catalog_manager.cc:4712] TS f3844f00bc7448949291a528b57e92b4 (127.5.160.129:40277): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2c3b26d2f5144a69a4335b12a8e6bbce: Network error: Client connection negotiation failed: client connection to 127.5.160.129:40277: connect: Connection refused (error 111)
I20251211 15:03:19.179158 13933 catalog_manager.cc:4985] TS bd32e8d91cb6468e84d61da64e6b09a7 (127.5.160.131:32929): tablet 2c3b26d2f5144a69a4335b12a8e6bbce (table test-table [id=0807112e168645c9945da4dfdcfd4ec4]) successfully deleted
I20251211 15:03:19.183072  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 14306
I20251211 15:03:19.190001  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 13916
2025-12-11T15:03:19Z chronyd exiting
[       OK ] SecurityITest.TestNonDefaultPrincipal (4118 ms)
[ RUN      ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:03:19 dist-test-slave-4k3m krb5kdc[14566](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:03:19 dist-test-slave-4k3m krb5kdc[14566](info): set up 2 sockets
Dec 11 15:03:19 dist-test-slave-4k3m krb5kdc[14566](info): commencing operation
krb5kdc: starting...
W20251211 15:03:21.035737  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.823s	user 0.001s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:03:21 dist-test-slave-4k3m krb5kdc[14566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465401, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:03:21Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:03:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:03:21.173609  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40631
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:39607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:40631
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:21.281666 14582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:21.281919 14582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:21.281976 14582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:21.285351 14582 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:03:21.285430 14582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:21.285454 14582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:21.285472 14582 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:03:21.285488 14582 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:03:21.290374 14582 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:39607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:40631
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:21.291529 14582 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:21.292371 14582 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:21.298141 14587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:21.298197 14582 server_base.cc:1047] running on GCE node
W20251211 15:03:21.298144 14588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:21.298401 14590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:21.298993 14582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:21.299994 14582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:21.301162 14582 hybrid_clock.cc:648] HybridClock initialized: now 1765465401301142 us; error 42 us; skew 500 ppm
W20251211 15:03:21.304724 14582 builtin_ntp.cc:688] coult not shutdown socket: Network error: shutdown error: Transport endpoint is not connected (error 107)
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2025-12-11T15:03:21Z chronyd exiting
[       OK ] SecurityITest.TestNonExistentPrincipal (2121 ms)
[ RUN      ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:03:21 dist-test-slave-4k3m krb5kdc[14595](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:03:21 dist-test-slave-4k3m krb5kdc[14595](info): set up 2 sockets
Dec 11 15:03:21 dist-test-slave-4k3m krb5kdc[14595](info): commencing operation
krb5kdc: starting...
W20251211 15:03:23.143610  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.810s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:03:23 dist-test-slave-4k3m krb5kdc[14595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:03:23Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:03:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:03:23.282101  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40959
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:41155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:40959
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:23.391299 14611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:23.391537 14611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:23.391592 14611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:23.394994 14611 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:03:23.395076 14611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:23.395112 14611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:23.395129 14611 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:03:23.395145 14611 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:03:23.399725 14611 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:41155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:40959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:23.400879 14611 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:23.401731 14611 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:23.407377 14616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:23.407485 14617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:23.407485 14619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:23.407802 14611 server_base.cc:1047] running on GCE node
I20251211 15:03:23.408313 14611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:23.409222 14611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:23.410396 14611 hybrid_clock.cc:648] HybridClock initialized: now 1765465403410387 us; error 35 us; skew 500 ppm
Dec 11 15:03:23 dist-test-slave-4k3m krb5kdc[14595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465403, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:23.413115 14611 init.cc:377] Logged in from keytab as kudu/127.5.160.190@KRBTEST.COM (short username kudu)
I20251211 15:03:23.414290 14611 webserver.cc:492] Webserver started at http://127.5.160.190:34301/ using document root <none> and password file <none>
I20251211 15:03:23.414832 14611 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:23.414883 14611 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:23.415102 14611 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:23.416860 14611 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "98ce172b93e74cef8efd736a11737c65"
format_stamp: "Formatted at 2025-12-11 15:03:23 on dist-test-slave-4k3m"
server_key: "bf2b9f091f3d98e2c17c55188b12ea5d"
server_key_iv: "06ac4d7ebf8075a7c696b07800bd5f5d"
server_key_version: "encryptionkey@0"
I20251211 15:03:23.417382 14611 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "98ce172b93e74cef8efd736a11737c65"
format_stamp: "Formatted at 2025-12-11 15:03:23 on dist-test-slave-4k3m"
server_key: "bf2b9f091f3d98e2c17c55188b12ea5d"
server_key_iv: "06ac4d7ebf8075a7c696b07800bd5f5d"
server_key_version: "encryptionkey@0"
I20251211 15:03:23.421082 14611 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20251211 15:03:23.423600 14626 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:23.424742 14611 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:23.424880 14611 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "98ce172b93e74cef8efd736a11737c65"
format_stamp: "Formatted at 2025-12-11 15:03:23 on dist-test-slave-4k3m"
server_key: "bf2b9f091f3d98e2c17c55188b12ea5d"
server_key_iv: "06ac4d7ebf8075a7c696b07800bd5f5d"
server_key_version: "encryptionkey@0"
I20251211 15:03:23.424986 14611 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:23.449348 14611 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:23.452569 14611 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:23.452746 14611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:23.459797 14611 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:40959
I20251211 15:03:23.459797 14678 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:40959 every 8 connection(s)
I20251211 15:03:23.460817 14611 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:03:23.463560 14679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:23.468187  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 14611
I20251211 15:03:23.468331  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:03:23.468575  5762 external_mini_cluster.cc:1468] Setting key 9501b5233517b2c8eb567f32a138c077
I20251211 15:03:23.469424 14679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65: Bootstrap starting.
I20251211 15:03:23.471746 14679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:23.472465 14679 log.cc:826] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:23.474164 14679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65: No bootstrap required, opened a new log
Dec 11 15:03:23 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:03:23.477543 14679 raft_consensus.cc:359] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98ce172b93e74cef8efd736a11737c65" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40959 } }
I20251211 15:03:23.477782 14679 raft_consensus.cc:385] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:23.477825 14679 raft_consensus.cc:740] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98ce172b93e74cef8efd736a11737c65, State: Initialized, Role: FOLLOWER
I20251211 15:03:23.478266 14679 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98ce172b93e74cef8efd736a11737c65" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40959 } }
I20251211 15:03:23.478389 14679 raft_consensus.cc:399] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:03:23.478447 14679 raft_consensus.cc:493] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:03:23.478534 14679 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:23.479579 14679 raft_consensus.cc:515] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98ce172b93e74cef8efd736a11737c65" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40959 } }
I20251211 15:03:23.479961 14679 leader_election.cc:304] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98ce172b93e74cef8efd736a11737c65; no voters: 
I20251211 15:03:23.480269 14679 leader_election.cc:290] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:03:23.480657 14684 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:23.480870 14684 raft_consensus.cc:697] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 1 LEADER]: Becoming Leader. State: Replica: 98ce172b93e74cef8efd736a11737c65, State: Running, Role: LEADER
I20251211 15:03:23.481232 14684 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98ce172b93e74cef8efd736a11737c65" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40959 } }
I20251211 15:03:23.481472 14679 sys_catalog.cc:565] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:03:23.482131 14682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:23.469947 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45502 (local address 127.5.160.190:40959)
1211 15:03:23.470387 (+   440us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:23.470397 (+    10us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:23.470431 (+    34us) server_negotiation.cc:408] Connection header received
1211 15:03:23.471023 (+   592us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:23.471043 (+    20us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:23.471344 (+   301us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:23.471655 (+   311us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:23.472569 (+   914us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:23.473339 (+   770us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:23.474000 (+   661us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:23.474303 (+   303us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:23.476609 (+  2306us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:23.476630 (+    21us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:23.476642 (+    12us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:23.476678 (+    36us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:23.478726 (+  2048us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:23.479326 (+   600us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:23.479331 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:23.479336 (+     5us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:23.479418 (+    82us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:23.479687 (+   269us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:23.479691 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:23.479692 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:23.480071 (+   379us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:23.480294 (+   223us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:23.480627 (+   333us) server_negotiation.cc:300] Negotiation successful
1211 15:03:23.481219 (+   592us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":143,"threads_started":1}
I20251211 15:03:23.482363 14685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98ce172b93e74cef8efd736a11737c65. Latest consensus state: current_term: 1 leader_uuid: "98ce172b93e74cef8efd736a11737c65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98ce172b93e74cef8efd736a11737c65" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40959 } } }
I20251211 15:03:23.482470 14685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:23.482731 14686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "98ce172b93e74cef8efd736a11737c65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98ce172b93e74cef8efd736a11737c65" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40959 } } }
I20251211 15:03:23.482805 14686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [sys.catalog]: This master's current role is: LEADER
W20251211 15:03:23.486836 14699 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251211 15:03:23.486917 14699 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251211 15:03:23.487011 14693 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:03:23.487716 14693 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:03:23.493667 14693 catalog_manager.cc:1357] Generated new cluster ID: f2f98bd4044e404a8e57c9abcba9796d
I20251211 15:03:23.493754 14693 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:03:23.500905 14693 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:03:23.501859 14693 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:03:23.511315 14693 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65: Generated new TSK 0
I20251211 15:03:23.512091 14693 catalog_manager.cc:1524] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:03:23.569654  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40959
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:41155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:23.679227 14707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:23.679459 14707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:23.679523 14707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:23.682880 14707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:23.682984 14707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:23.683087 14707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:03:23.687553 14707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:41155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:40959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:23.688669 14707 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:23.689577 14707 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:23.696576 14712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:23.696637 14713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:23.696576 14715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:23.696738 14707 server_base.cc:1047] running on GCE node
I20251211 15:03:23.697563 14707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:23.698158 14707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:23.699349 14707 hybrid_clock.cc:648] HybridClock initialized: now 1765465403699337 us; error 32 us; skew 500 ppm
Dec 11 15:03:23 dist-test-slave-4k3m krb5kdc[14595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465403, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:23.702171 14707 init.cc:377] Logged in from keytab as kudu/127.5.160.129@KRBTEST.COM (short username kudu)
I20251211 15:03:23.703378 14707 webserver.cc:492] Webserver started at http://127.5.160.129:34061/ using document root <none> and password file <none>
I20251211 15:03:23.703990 14707 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:23.704046 14707 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:23.704253 14707 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:23.706017 14707 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "2e9f05c6d6cd4a848888d8cee6c2f24e"
format_stamp: "Formatted at 2025-12-11 15:03:23 on dist-test-slave-4k3m"
server_key: "63e5813aa6f5c0b6d0159d1c1c22c778"
server_key_iv: "6537ab3bda297eb01474a1ff72bbe8f7"
server_key_version: "encryptionkey@0"
I20251211 15:03:23.706522 14707 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "2e9f05c6d6cd4a848888d8cee6c2f24e"
format_stamp: "Formatted at 2025-12-11 15:03:23 on dist-test-slave-4k3m"
server_key: "63e5813aa6f5c0b6d0159d1c1c22c778"
server_key_iv: "6537ab3bda297eb01474a1ff72bbe8f7"
server_key_version: "encryptionkey@0"
I20251211 15:03:23.710309 14707 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20251211 15:03:23.712845 14722 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:23.713939 14707 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:23.714071 14707 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "2e9f05c6d6cd4a848888d8cee6c2f24e"
format_stamp: "Formatted at 2025-12-11 15:03:23 on dist-test-slave-4k3m"
server_key: "63e5813aa6f5c0b6d0159d1c1c22c778"
server_key_iv: "6537ab3bda297eb01474a1ff72bbe8f7"
server_key_version: "encryptionkey@0"
I20251211 15:03:23.714175 14707 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:23.741830 14707 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:23.745754 14707 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:23.745939 14707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:23.746485 14707 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:23.747505 14707 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:23.747563 14707 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:23.747617 14707 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:23.747637 14707 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:23.756772 14707 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:43033
I20251211 15:03:23.756790 14835 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:43033 every 8 connection(s)
I20251211 15:03:23.757736 14707 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:03:23.765990  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 14707
I20251211 15:03:23.766124  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
Dec 11 15:03:23 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465403, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:03:23.766424  5762 external_mini_cluster.cc:1468] Setting key 49cfab108cdfea9cfa3fb7363608ed52
I20251211 15:03:23.770860 14682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:23.759620 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:37227 (local address 127.5.160.190:40959)
1211 15:03:23.759748 (+   128us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:23.759752 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:23.760461 (+   709us) server_negotiation.cc:408] Connection header received
1211 15:03:23.761325 (+   864us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:23.761329 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:23.761389 (+    60us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:23.761458 (+    69us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:23.763218 (+  1760us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:23.763728 (+   510us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:23.764381 (+   653us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:23.764562 (+   181us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:23.766977 (+  2415us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:23.767006 (+    29us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:23.767010 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:23.767040 (+    30us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:23.768527 (+  1487us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:23.769152 (+   625us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:23.769155 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:23.769156 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:23.769216 (+    60us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:23.769611 (+   395us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:23.769615 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:23.769617 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:23.769832 (+   215us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:23.769960 (+   128us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:23.770607 (+   647us) server_negotiation.cc:300] Negotiation successful
1211 15:03:23.770720 (+   113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20251211 15:03:23.771744 14838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:23.759811 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:37227)
1211 15:03:23.760308 (+   497us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:23.760347 (+    39us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:23.761110 (+   763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:23.761632 (+   522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:23.761640 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:23.762050 (+   410us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:23.763055 (+  1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:23.763072 (+    17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:23.763853 (+   781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:23.763856 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:23.764268 (+   412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:23.764276 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:23.764506 (+   230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:23.765183 (+   677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:23.765211 (+    28us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:23.766763 (+  1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:23.768662 (+  1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:23.768668 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:23.768683 (+    15us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:23.769009 (+   326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:23.769330 (+   321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:23.769333 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:23.769335 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:23.769473 (+   138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:23.769995 (+   522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:23.770002 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:23.770326 (+   324us) client_negotiation.cc:769] Sending connection context
1211 15:03:23.770574 (+   248us) client_negotiation.cc:240] Negotiation successful
1211 15:03:23.770868 (+   294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":117,"threads_started":1}
I20251211 15:03:23.772953 14836 heartbeater.cc:344] Connected to a master server at 127.5.160.190:40959
I20251211 15:03:23.773247 14836 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:23.773919 14836 heartbeater.cc:507] Master 127.5.160.190:40959 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.5.160.130@KRBTEST.COM; defaulting to no policy
I20251211 15:03:23.775656 14643 ts_manager.cc:194] Registered new tserver with Master: 2e9f05c6d6cd4a848888d8cee6c2f24e (127.5.160.129:43033)
I20251211 15:03:23.776854 14643 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:37227
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:03:23.818536  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40959
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:41155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:23.928023 14843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:23.928277 14843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:23.928357 14843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:23.931957 14843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:23.932111 14843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:23.932235 14843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:03:23.937052 14843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:41155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:40959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:23.938205 14843 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:23.939138 14843 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:23.945829 14849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:23.945829 14848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:23.945829 14851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:23.946056 14843 server_base.cc:1047] running on GCE node
I20251211 15:03:23.946493 14843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:23.947049 14843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:23.948199 14843 hybrid_clock.cc:648] HybridClock initialized: now 1765465403948177 us; error 33 us; skew 500 ppm
Dec 11 15:03:23 dist-test-slave-4k3m krb5kdc[14595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465403, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:23.950891 14843 init.cc:377] Logged in from keytab as kudu/127.5.160.130@KRBTEST.COM (short username kudu)
I20251211 15:03:23.952009 14843 webserver.cc:492] Webserver started at http://127.5.160.130:33137/ using document root <none> and password file <none>
I20251211 15:03:23.952544 14843 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:23.952589 14843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:23.952769 14843 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:23.954447 14843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "c38a27566e04443783041ba02fe782df"
format_stamp: "Formatted at 2025-12-11 15:03:23 on dist-test-slave-4k3m"
server_key: "a88627b654f0c37dcc66b57fa99348ae"
server_key_iv: "6ae02de6f2aa0b37b8160f6187605f2a"
server_key_version: "encryptionkey@0"
I20251211 15:03:23.954977 14843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "c38a27566e04443783041ba02fe782df"
format_stamp: "Formatted at 2025-12-11 15:03:23 on dist-test-slave-4k3m"
server_key: "a88627b654f0c37dcc66b57fa99348ae"
server_key_iv: "6ae02de6f2aa0b37b8160f6187605f2a"
server_key_version: "encryptionkey@0"
I20251211 15:03:23.958305 14843 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20251211 15:03:23.960567 14858 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:23.961581 14843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:03:23.961676 14843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "c38a27566e04443783041ba02fe782df"
format_stamp: "Formatted at 2025-12-11 15:03:23 on dist-test-slave-4k3m"
server_key: "a88627b654f0c37dcc66b57fa99348ae"
server_key_iv: "6ae02de6f2aa0b37b8160f6187605f2a"
server_key_version: "encryptionkey@0"
I20251211 15:03:23.961760 14843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:23.973635 14843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:23.976876 14843 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:23.977044 14843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:23.977566 14843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:23.978469 14843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:23.978518 14843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:23.978556 14843 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:23.978569 14843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:23.988193 14843 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:46581
I20251211 15:03:23.988238 14971 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:46581 every 8 connection(s)
I20251211 15:03:23.989135 14843 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:03:23.995023  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 14843
I20251211 15:03:23.995132  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:03:23.995381  5762 external_mini_cluster.cc:1468] Setting key 82ac0d9c7edae957e64c9f5583b96284
Dec 11 15:03:23 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465403, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:03:24.002395 14682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:23.990974 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:53683 (local address 127.5.160.190:40959)
1211 15:03:23.991121 (+   147us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:23.991126 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:23.991820 (+   694us) server_negotiation.cc:408] Connection header received
1211 15:03:23.992700 (+   880us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:23.992704 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:23.992768 (+    64us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:23.992847 (+    79us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:23.994671 (+  1824us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:23.995468 (+   797us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:23.996204 (+   736us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:23.996391 (+   187us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:23.998784 (+  2393us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:23.998804 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:23.998806 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:23.998836 (+    30us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:24.000453 (+  1617us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:24.000969 (+   516us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:24.000973 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:24.000974 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:24.001029 (+    55us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:24.001307 (+   278us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:24.001311 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:24.001313 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:24.001476 (+   163us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:24.001563 (+    87us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:24.002085 (+   522us) server_negotiation.cc:300] Negotiation successful
1211 15:03:24.002225 (+   140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20251211 15:03:24.003147 14974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:23.991249 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:53683)
1211 15:03:23.991686 (+   437us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:23.991722 (+    36us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:23.992493 (+   771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:23.993071 (+   578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:23.993079 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:23.993495 (+   416us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:23.994503 (+  1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:23.994520 (+    17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:23.995598 (+  1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:23.995601 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:23.996096 (+   495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:23.996106 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:23.996293 (+   187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:23.996859 (+   566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:23.996885 (+    26us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:23.998557 (+  1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:24.000588 (+  2031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:24.000595 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:24.000609 (+    14us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:24.000865 (+   256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:24.001115 (+   250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:24.001117 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:24.001119 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:24.001220 (+   101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:24.001576 (+   356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:24.001584 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:24.001834 (+   250us) client_negotiation.cc:769] Sending connection context
1211 15:03:24.002034 (+   200us) client_negotiation.cc:240] Negotiation successful
1211 15:03:24.002344 (+   310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":106,"threads_started":1}
WARNING: no policy specified for kudu/127.5.160.131@KRBTEST.COM; defaulting to no policy
I20251211 15:03:24.004449 14972 heartbeater.cc:344] Connected to a master server at 127.5.160.190:40959
I20251211 15:03:24.004707 14972 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:24.005261 14972 heartbeater.cc:507] Master 127.5.160.190:40959 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.131@KRBTEST.COM" created.
I20251211 15:03:24.006539 14643 ts_manager.cc:194] Registered new tserver with Master: c38a27566e04443783041ba02fe782df (127.5.160.130:46581)
I20251211 15:03:24.007395 14643 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.130@KRBTEST.COM'} at 127.5.160.130:53683
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:03:24.045711  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:40959
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:41155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:24.158155 14979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:24.158393 14979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:24.158454 14979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:24.161826 14979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:24.161913 14979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:24.162029 14979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:03:24.167160 14979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:41155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:40959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:24.168293 14979 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:24.169123 14979 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:24.175715 14985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:24.175715 14987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:24.175765 14984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:24.175901 14979 server_base.cc:1047] running on GCE node
I20251211 15:03:24.176457 14979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:24.177026 14979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:24.178221 14979 hybrid_clock.cc:648] HybridClock initialized: now 1765465404178202 us; error 36 us; skew 500 ppm
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465404, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:24.180892 14979 init.cc:377] Logged in from keytab as kudu/127.5.160.131@KRBTEST.COM (short username kudu)
I20251211 15:03:24.181975 14979 webserver.cc:492] Webserver started at http://127.5.160.131:41043/ using document root <none> and password file <none>
I20251211 15:03:24.182607 14979 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:24.182662 14979 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:24.182838 14979 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:24.184613 14979 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "3894a4164bf445ac8f74f89891f1662c"
format_stamp: "Formatted at 2025-12-11 15:03:24 on dist-test-slave-4k3m"
server_key: "51c7433786345d5c309d59f228e635a7"
server_key_iv: "c2f9e9c7a57ac24749ad46369b7178a5"
server_key_version: "encryptionkey@0"
I20251211 15:03:24.185086 14979 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "3894a4164bf445ac8f74f89891f1662c"
format_stamp: "Formatted at 2025-12-11 15:03:24 on dist-test-slave-4k3m"
server_key: "51c7433786345d5c309d59f228e635a7"
server_key_iv: "c2f9e9c7a57ac24749ad46369b7178a5"
server_key_version: "encryptionkey@0"
I20251211 15:03:24.188530 14979 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20251211 15:03:24.190863 14994 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:24.192027 14979 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:24.192137 14979 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "3894a4164bf445ac8f74f89891f1662c"
format_stamp: "Formatted at 2025-12-11 15:03:24 on dist-test-slave-4k3m"
server_key: "51c7433786345d5c309d59f228e635a7"
server_key_iv: "c2f9e9c7a57ac24749ad46369b7178a5"
server_key_version: "encryptionkey@0"
I20251211 15:03:24.192225 14979 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:24.203907 14979 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:24.206907 14979 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:24.207119 14979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:24.207731 14979 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:24.208600 14979 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:24.208648 14979 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:24.208699 14979 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:24.208724 14979 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:24.217319 14979 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:41183
I20251211 15:03:24.217342 15107 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:41183 every 8 connection(s)
I20251211 15:03:24.218516 14979 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465404, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:03:24.228439  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 14979
I20251211 15:03:24.228555  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:03:24.228768  5762 external_mini_cluster.cc:1468] Setting key 7bed691dac1e77761ab773d802cc1f8d
I20251211 15:03:24.230792 14682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:24.220289 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:43267 (local address 127.5.160.190:40959)
1211 15:03:24.220453 (+   164us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:24.220457 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:24.221071 (+   614us) server_negotiation.cc:408] Connection header received
1211 15:03:24.222091 (+  1020us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:24.222095 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:24.222153 (+    58us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:24.222220 (+    67us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:24.223878 (+  1658us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.224378 (+   500us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:24.224994 (+   616us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.225169 (+   175us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:24.227331 (+  2162us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:24.227354 (+    23us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:24.227357 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:24.227385 (+    28us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:24.228731 (+  1346us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:24.229179 (+   448us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:24.229182 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:24.229185 (+     3us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:24.229250 (+    65us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:24.229653 (+   403us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:24.229656 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:24.229658 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:24.229833 (+   175us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:24.229926 (+    93us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:24.230531 (+   605us) server_negotiation.cc:300] Negotiation successful
1211 15:03:24.230653 (+   122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20251211 15:03:24.231498 15110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:24.220527 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:43267)
1211 15:03:24.220943 (+   416us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:24.220977 (+    34us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:24.221880 (+   903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:24.222374 (+   494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:24.222382 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:24.222764 (+   382us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:24.223731 (+   967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:24.223745 (+    14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.224495 (+   750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:24.224498 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:24.224888 (+   390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:24.224895 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.225126 (+   231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:24.225709 (+   583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:24.225733 (+    24us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:24.227180 (+  1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:24.228833 (+  1653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:24.228839 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:24.228852 (+    13us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:24.229086 (+   234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:24.229350 (+   264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:24.229353 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:24.229356 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:24.229539 (+   183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:24.229940 (+   401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:24.229948 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:24.230261 (+   313us) client_negotiation.cc:769] Sending connection context
1211 15:03:24.230488 (+   227us) client_negotiation.cc:240] Negotiation successful
1211 15:03:24.230769 (+   281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":100,"threads_started":1}
I20251211 15:03:24.232520 15108 heartbeater.cc:344] Connected to a master server at 127.5.160.190:40959
I20251211 15:03:24.232744 15108 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:24.233235 15108 heartbeater.cc:507] Master 127.5.160.190:40959 requested a full tablet report, sending...
I20251211 15:03:24.234158 14643 ts_manager.cc:194] Registered new tserver with Master: 3894a4164bf445ac8f74f89891f1662c (127.5.160.131:41183)
I20251211 15:03:24.234700 14643 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.131@KRBTEST.COM'} at 127.5.160.131:43267
I20251211 15:03:24.242722  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/oryx_127.5.160.129.keytab.
Entry for principal oryx/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/oryx_127.5.160.129.keytab.
WARNING: no policy specified for oryx/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/oryx_127.5.160.130.keytab.
Entry for principal oryx/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/oryx_127.5.160.130.keytab.
WARNING: no policy specified for oryx/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/oryx_127.5.160.131.keytab.
Entry for principal oryx/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/oryx_127.5.160.131.keytab.
I20251211 15:03:24.314141  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 14707
I20251211 15:03:24.319348  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 14843
I20251211 15:03:24.324208  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 14979
I20251211 15:03:24.328959  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 14611
I20251211 15:03:24.334702  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40959
--webserver_interface=127.5.160.190
--webserver_port=34301
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:41155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:40959
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:24.441651 15117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:24.441915 15117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:24.441994 15117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:24.445452 15117 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:03:24.445540 15117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:24.445571 15117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:24.445595 15117 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:03:24.445629 15117 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:03:24.450142 15117 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:41155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:40959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:40959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=34301
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:24.451280 15117 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:24.452159 15117 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:24.457914 15123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:24.457998 15122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:24.457914 15125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:24.458215 15117 server_base.cc:1047] running on GCE node
I20251211 15:03:24.458714 15117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:24.459684 15117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:24.460834 15117 hybrid_clock.cc:648] HybridClock initialized: now 1765465404460818 us; error 34 us; skew 500 ppm
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465404, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:24.463505 15117 init.cc:377] Logged in from keytab as kudu/127.5.160.190@KRBTEST.COM (short username kudu)
I20251211 15:03:24.464627 15117 webserver.cc:492] Webserver started at http://127.5.160.190:34301/ using document root <none> and password file <none>
I20251211 15:03:24.465173 15117 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:24.465233 15117 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:24.468824 15117 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:24.470917 15132 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:24.472095 15117 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:24.472229 15117 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "98ce172b93e74cef8efd736a11737c65"
format_stamp: "Formatted at 2025-12-11 15:03:23 on dist-test-slave-4k3m"
server_key: "bf2b9f091f3d98e2c17c55188b12ea5d"
server_key_iv: "06ac4d7ebf8075a7c696b07800bd5f5d"
server_key_version: "encryptionkey@0"
I20251211 15:03:24.472697 15117 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:24.495723 15117 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:24.501475 15117 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:24.501637 15117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:24.509135 15184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:40959 every 8 connection(s)
I20251211 15:03:24.509179 15117 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:40959
I20251211 15:03:24.510290 15117 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:03:24.510466  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 15117
I20251211 15:03:24.510883  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:43033
--local_ip_for_outbound_sockets=127.5.160.129
--tserver_master_addrs=127.5.160.190:40959
--webserver_port=34061
--webserver_interface=127.5.160.129
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:41155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.5.160.129
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/oryx_127.5.160.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20251211 15:03:24.515815 15185 sys_catalog.cc:263] Verifying existing consensus state
I20251211 15:03:24.518035 15185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65: Bootstrap starting.
I20251211 15:03:24.536026 15185 log.cc:826] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:24.542402 15185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 15:03:24.542773 15185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65: Bootstrap complete.
I20251211 15:03:24.546356 15185 raft_consensus.cc:359] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98ce172b93e74cef8efd736a11737c65" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40959 } }
I20251211 15:03:24.546689 15185 raft_consensus.cc:740] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98ce172b93e74cef8efd736a11737c65, State: Initialized, Role: FOLLOWER
I20251211 15:03:24.547242 15185 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98ce172b93e74cef8efd736a11737c65" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40959 } }
I20251211 15:03:24.547365 15185 raft_consensus.cc:399] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:03:24.547427 15185 raft_consensus.cc:493] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:03:24.547520 15185 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 1 FOLLOWER]: Advancing to term 2
I20251211 15:03:24.549072 15185 raft_consensus.cc:515] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98ce172b93e74cef8efd736a11737c65" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40959 } }
I20251211 15:03:24.549387 15185 leader_election.cc:304] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98ce172b93e74cef8efd736a11737c65; no voters: 
I20251211 15:03:24.549655 15185 leader_election.cc:290] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [CANDIDATE]: Term 2 election: Requested vote from peers 
I20251211 15:03:24.549808 15189 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 15:03:24.550046 15189 raft_consensus.cc:697] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [term 2 LEADER]: Becoming Leader. State: Replica: 98ce172b93e74cef8efd736a11737c65, State: Running, Role: LEADER
I20251211 15:03:24.550354 15189 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98ce172b93e74cef8efd736a11737c65" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40959 } }
I20251211 15:03:24.550783 15185 sys_catalog.cc:565] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:03:24.551935 15190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "98ce172b93e74cef8efd736a11737c65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98ce172b93e74cef8efd736a11737c65" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40959 } } }
I20251211 15:03:24.552047 15190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:24.552138 15191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98ce172b93e74cef8efd736a11737c65. Latest consensus state: current_term: 2 leader_uuid: "98ce172b93e74cef8efd736a11737c65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98ce172b93e74cef8efd736a11737c65" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 40959 } } }
I20251211 15:03:24.552356 15191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:24.552735 15198 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:03:24.556087 15198 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:03:24.556777 15198 catalog_manager.cc:1269] Loaded cluster ID: f2f98bd4044e404a8e57c9abcba9796d
I20251211 15:03:24.556839 15198 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:03:24.559453 15198 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:03:24.560209 15198 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 98ce172b93e74cef8efd736a11737c65: Loaded TSK: 0
I20251211 15:03:24.561482 15198 catalog_manager.cc:1524] Initializing in-progress tserver states...
W20251211 15:03:24.627887 15187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:24.628129 15187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:24.628211 15187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:24.631666 15187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:24.631745 15187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:24.631852 15187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:03:24.636344 15187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:41155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/oryx_127.5.160.129.keytab
--principal=oryx/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:43033
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=34061
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:40959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:24.637487 15187 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:24.638336 15187 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:24.645015 15214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:24.645053 15212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:24.645002 15211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:24.645414 15187 server_base.cc:1047] running on GCE node
I20251211 15:03:24.645782 15187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:24.646381 15187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:24.647536 15187 hybrid_clock.cc:648] HybridClock initialized: now 1765465404647520 us; error 35 us; skew 500 ppm
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465404, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:24.650085 15187 init.cc:377] Logged in from keytab as oryx/127.5.160.129@KRBTEST.COM (short username oryx)
I20251211 15:03:24.651218 15187 webserver.cc:492] Webserver started at http://127.5.160.129:34061/ using document root <none> and password file <none>
I20251211 15:03:24.651760 15187 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:24.651825 15187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:24.655552 15187 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:24.657660 15221 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:24.658831 15187 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:24.658974 15187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "2e9f05c6d6cd4a848888d8cee6c2f24e"
format_stamp: "Formatted at 2025-12-11 15:03:23 on dist-test-slave-4k3m"
server_key: "63e5813aa6f5c0b6d0159d1c1c22c778"
server_key_iv: "6537ab3bda297eb01474a1ff72bbe8f7"
server_key_version: "encryptionkey@0"
I20251211 15:03:24.659463 15187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:24.679457 15187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:24.682471 15187 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:24.682654 15187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:24.683274 15187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:24.684165 15187 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:24.684217 15187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:24.684271 15187 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:24.684296 15187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:24.694538 15187 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:43033
I20251211 15:03:24.694551 15334 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:43033 every 8 connection(s)
I20251211 15:03:24.695631 15187 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:03:24.697144  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 15187
I20251211 15:03:24.697635  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:46581
--local_ip_for_outbound_sockets=127.5.160.130
--tserver_master_addrs=127.5.160.190:40959
--webserver_port=33137
--webserver_interface=127.5.160.130
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:41155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.5.160.130
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/oryx_127.5.160.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:24.708369 15337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:24.697715 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:34295)
1211 15:03:24.698239 (+   524us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:24.698285 (+    46us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:24.699862 (+  1577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:24.701023 (+  1161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:24.701032 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:24.701511 (+   479us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:24.702497 (+   986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:24.702515 (+    18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.703723 (+  1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:24.703727 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:24.704152 (+   425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:24.704160 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.704397 (+   237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:24.705045 (+   648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:24.705073 (+    28us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:24.707433 (+  2360us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":128,"threads_started":1}
W20251211 15:03:24.708361 15339 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:24.699046 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:34295 (local address 127.5.160.190:40959)
1211 15:03:24.699539 (+   493us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:24.699552 (+    13us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:24.699598 (+    46us) server_negotiation.cc:408] Connection header received
1211 15:03:24.700287 (+   689us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:24.700298 (+    11us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:24.700617 (+   319us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:24.700910 (+   293us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:24.702690 (+  1780us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.703562 (+   872us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:24.704275 (+   713us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.704533 (+   258us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:24.707650 (+  3117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:34295: BlockingRecv error: recv got EOF from 127.5.160.129:34295 (error 108)
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":125,"threads_started":1}
W20251211 15:03:24.709285 15335 heartbeater.cc:646] Failed to heartbeat to 127.5.160.190:40959 (0 consecutive failures): Not authorized: Failed to ping master at 127.5.160.190:40959: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:24.714774 15337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:24.709798 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:56367)
1211 15:03:24.710020 (+   222us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:24.710032 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:24.710113 (+    81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:24.710442 (+   329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:24.710445 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:24.710607 (+   162us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:24.710802 (+   195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:24.710808 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.711712 (+   904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:24.711716 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:24.712106 (+   390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:24.712113 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.712224 (+   111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:24.712907 (+   683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:24.712921 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:24.714639 (+  1718us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149}
W20251211 15:03:24.714893 15339 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:24.709897 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:56367 (local address 127.5.160.190:40959)
1211 15:03:24.710234 (+   337us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:24.710237 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:24.710247 (+    10us) server_negotiation.cc:408] Connection header received
1211 15:03:24.710282 (+    35us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:24.710284 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:24.710335 (+    51us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:24.710401 (+    66us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:24.710923 (+   522us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.711596 (+   673us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:24.712214 (+   618us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.712517 (+   303us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:24.714788 (+  2271us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:56367: BlockingRecv error: recv got EOF from 127.5.160.129:56367 (error 108)
Metrics: {"server-negotiator.queue_time_us":269}
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:24.719861 15337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:24.715540 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:34073)
1211 15:03:24.715714 (+   174us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:24.715727 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:24.715815 (+    88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:24.716040 (+   225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:24.716042 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:24.716189 (+   147us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:24.716349 (+   160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:24.716354 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.717048 (+   694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:24.717051 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:24.717420 (+   369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:24.717427 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.717529 (+   102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:24.718019 (+   490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:24.718035 (+    16us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:24.719726 (+  1691us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102}
W20251211 15:03:24.719964 15339 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:24.715603 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:34073 (local address 127.5.160.190:40959)
1211 15:03:24.715715 (+   112us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:24.715720 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:24.715769 (+    49us) server_negotiation.cc:408] Connection header received
1211 15:03:24.715896 (+   127us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:24.715899 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:24.715946 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:24.716010 (+    64us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:24.716472 (+   462us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.716946 (+   474us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:24.717526 (+   580us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.717991 (+   465us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:24.719864 (+  1873us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:34073: BlockingRecv error: recv got EOF from 127.5.160.129:34073 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20251211 15:03:24.720391 15335 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20251211 15:03:24.815337 15338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:24.815580 15338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:24.815641 15338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:24.819530 15338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:24.819607 15338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:24.819690 15338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:03:24.824173 15338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:41155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/oryx_127.5.160.130.keytab
--principal=oryx/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:46581
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=33137
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:40959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:24.825496 15338 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:24.826308 15338 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:24.833082 15345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:24.833112 15347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:24.833320 15344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:24.833411 15338 server_base.cc:1047] running on GCE node
I20251211 15:03:24.833858 15338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:24.834468 15338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:24.835630 15338 hybrid_clock.cc:648] HybridClock initialized: now 1765465404835614 us; error 33 us; skew 500 ppm
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465404, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:24.838395 15338 init.cc:377] Logged in from keytab as oryx/127.5.160.130@KRBTEST.COM (short username oryx)
I20251211 15:03:24.839622 15338 webserver.cc:492] Webserver started at http://127.5.160.130:33137/ using document root <none> and password file <none>
I20251211 15:03:24.840220 15338 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:24.840292 15338 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:24.844005 15338 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:24.845880 15354 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:24.847043 15338 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:24.847154 15338 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "c38a27566e04443783041ba02fe782df"
format_stamp: "Formatted at 2025-12-11 15:03:23 on dist-test-slave-4k3m"
server_key: "a88627b654f0c37dcc66b57fa99348ae"
server_key_iv: "6ae02de6f2aa0b37b8160f6187605f2a"
server_key_version: "encryptionkey@0"
I20251211 15:03:24.847586 15338 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:24.860687 15338 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:24.863835 15338 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:24.864045 15338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:24.864658 15338 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:24.865609 15338 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:24.865669 15338 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:24.865727 15338 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:24.865758 15338 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:24.875705 15338 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:46581
I20251211 15:03:24.875777 15467 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:46581 every 8 connection(s)
I20251211 15:03:24.876761 15338 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:03:24.884720  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 15338
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:24.885212  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:41183
--local_ip_for_outbound_sockets=127.5.160.131
--tserver_master_addrs=127.5.160.190:40959
--webserver_port=41043
--webserver_interface=127.5.160.131
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:41155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.5.160.131
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/oryx_127.5.160.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
W20251211 15:03:24.886909 15339 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:24.878537 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:57153 (local address 127.5.160.190:40959)
1211 15:03:24.878663 (+   126us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:24.878666 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:24.879421 (+   755us) server_negotiation.cc:408] Connection header received
1211 15:03:24.880250 (+   829us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:24.880254 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:24.880316 (+    62us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:24.880414 (+    98us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:24.882022 (+  1608us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.882518 (+   496us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:24.883173 (+   655us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.883357 (+   184us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:24.886785 (+  3428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:57153: BlockingRecv error: recv got EOF from 127.5.160.130:57153 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20251211 15:03:24.887439 15470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:24.878764 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:57153)
1211 15:03:24.879276 (+   512us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:24.879312 (+    36us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:24.880047 (+   735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:24.880584 (+   537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:24.880593 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:24.880965 (+   372us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:24.881869 (+   904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:24.881882 (+    13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.882633 (+   751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:24.882636 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:24.883054 (+   418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:24.883061 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.883278 (+   217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:24.883908 (+   630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:24.883933 (+    25us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:24.886585 (+  2652us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":147,"threads_started":1}
W20251211 15:03:24.887864 15468 heartbeater.cc:646] Failed to heartbeat to 127.5.160.190:40959 (0 consecutive failures): Not authorized: Failed to ping master at 127.5.160.190:40959: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:24.893041 15470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:24.888349 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:45235)
1211 15:03:24.888452 (+   103us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:24.888466 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:24.888547 (+    81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:24.888782 (+   235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:24.888784 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:24.888936 (+   152us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:24.889128 (+   192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:24.889134 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.889816 (+   682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:24.889818 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:24.890220 (+   402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:24.890229 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.890332 (+   103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:24.890996 (+   664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:24.891011 (+    15us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:24.892907 (+  1896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":26}
W20251211 15:03:24.893175 15339 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:24.888454 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:45235 (local address 127.5.160.190:40959)
1211 15:03:24.888595 (+   141us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:24.888600 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:24.888612 (+    12us) server_negotiation.cc:408] Connection header received
1211 15:03:24.888649 (+    37us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:24.888652 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:24.888691 (+    39us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:24.888755 (+    64us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:24.889241 (+   486us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.889713 (+   472us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:24.890328 (+   615us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.890508 (+   180us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:24.893075 (+  2567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:45235: BlockingRecv error: recv got EOF from 127.5.160.130:45235 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:24 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:24.898402 15470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:24.893872 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:40479)
1211 15:03:24.894050 (+   178us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:24.894063 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:24.894144 (+    81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:24.894378 (+   234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:24.894381 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:24.894517 (+   136us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:24.894676 (+   159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:24.894682 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.895409 (+   727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:24.895412 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:24.895766 (+   354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:24.895772 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.895867 (+    95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:24.896400 (+   533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:24.896412 (+    12us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:24.898239 (+  1827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98}
W20251211 15:03:24.898526 15339 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:24.893972 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:40479 (local address 127.5.160.190:40959)
1211 15:03:24.894158 (+   186us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:24.894162 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:24.894186 (+    24us) server_negotiation.cc:408] Connection header received
1211 15:03:24.894225 (+    39us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:24.894227 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:24.894265 (+    38us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:24.894326 (+    61us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:24.894782 (+   456us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.895307 (+   525us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:24.895862 (+   555us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:24.896035 (+   173us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:24.898408 (+  2373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:40479: BlockingRecv error: recv got EOF from 127.5.160.130:40479 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20251211 15:03:24.898742 15468 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20251211 15:03:24.998134 15471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:24.998406 15471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:24.998489 15471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:25.002070 15471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:25.002151 15471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:25.002257 15471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:03:25.006798 15471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:41155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/krb5kdc/oryx_127.5.160.131.keytab
--principal=oryx/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:41183
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=41043
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:40959
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:25.007961 15471 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:25.008888 15471 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:25.016008 15476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:25.016321 15477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:25.016165 15479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:25.016500 15471 server_base.cc:1047] running on GCE node
I20251211 15:03:25.016884 15471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:25.017540 15471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:25.018726 15471 hybrid_clock.cc:648] HybridClock initialized: now 1765465405018698 us; error 40 us; skew 500 ppm
Dec 11 15:03:25 dist-test-slave-4k3m krb5kdc[14595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465405, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:25.021544 15471 init.cc:377] Logged in from keytab as oryx/127.5.160.131@KRBTEST.COM (short username oryx)
I20251211 15:03:25.022706 15471 webserver.cc:492] Webserver started at http://127.5.160.131:41043/ using document root <none> and password file <none>
I20251211 15:03:25.023308 15471 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:25.023371 15471 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:25.027100 15471 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.004s	sys 0.000s
I20251211 15:03:25.029296 15486 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:25.030462 15471 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:25.030582 15471 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "3894a4164bf445ac8f74f89891f1662c"
format_stamp: "Formatted at 2025-12-11 15:03:24 on dist-test-slave-4k3m"
server_key: "51c7433786345d5c309d59f228e635a7"
server_key_iv: "c2f9e9c7a57ac24749ad46369b7178a5"
server_key_version: "encryptionkey@0"
I20251211 15:03:25.031169 15471 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:25.054486 15471 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:25.057866 15471 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:25.058054 15471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:25.058698 15471 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:25.059681 15471 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:25.059737 15471 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:25.059784 15471 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:25.059818 15471 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:25.069799 15471 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:41183
I20251211 15:03:25.069815 15599 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:41183 every 8 connection(s)
I20251211 15:03:25.070873 15471 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
I20251211 15:03:25.071758  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 15471
Dec 11 15:03:25 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:25 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:25.080760 15339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:25.072497 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60296 (local address 127.5.160.190:40959)
1211 15:03:25.072639 (+   142us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:25.072642 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:25.072794 (+   152us) server_negotiation.cc:408] Connection header received
1211 15:03:25.072921 (+   127us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:25.072924 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:25.072980 (+    56us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:25.073057 (+    77us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:25.073955 (+   898us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.074451 (+   496us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:25.075171 (+   720us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.075381 (+   210us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:25.076542 (+  1161us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:25.076562 (+    20us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:25.076573 (+    11us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:25.076617 (+    44us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:25.078643 (+  2026us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:25.079156 (+   513us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:25.079161 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:25.079166 (+     5us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:25.079251 (+    85us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:25.079480 (+   229us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:25.079483 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:25.079484 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:25.079798 (+   314us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:25.080005 (+   207us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:25.080422 (+   417us) server_negotiation.cc:300] Negotiation successful
1211 15:03:25.080639 (+   217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20251211 15:03:25.081333 15603 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:25.073000 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:45565 (local address 127.5.160.190:40959)
1211 15:03:25.073245 (+   245us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:25.073249 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:25.073750 (+   501us) server_negotiation.cc:408] Connection header received
1211 15:03:25.074618 (+   868us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:25.074621 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:25.074681 (+    60us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:25.074759 (+    78us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:25.076551 (+  1792us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.077044 (+   493us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:25.077817 (+   773us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.077997 (+   180us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:25.081225 (+  3228us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:45565: BlockingRecv error: recv got EOF from 127.5.160.131:45565 (error 108)
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":76,"threads_started":1}
I20251211 15:03:25.081666 15604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:25.073155 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:45565)
1211 15:03:25.073611 (+   456us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:25.073654 (+    43us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:25.074424 (+   770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:25.074922 (+   498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:25.074955 (+    33us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:25.075362 (+   407us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:25.076403 (+  1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:25.076418 (+    15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.077180 (+   762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:25.077183 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:25.077691 (+   508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:25.077701 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.077896 (+   195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:25.078360 (+   464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:25.078384 (+    24us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:25.080885 (+  2501us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":110,"threads_started":1}
W20251211 15:03:25.082134 15600 heartbeater.cc:646] Failed to heartbeat to 127.5.160.190:40959 (0 consecutive failures): Not authorized: Failed to ping master at 127.5.160.190:40959: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Dec 11 15:03:25 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:25 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:25.087203 15604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:25.082619 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:44021)
1211 15:03:25.082735 (+   116us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:25.082749 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:25.082828 (+    79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:25.083095 (+   267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:25.083099 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:25.083227 (+   128us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:25.083466 (+   239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:25.083474 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.084191 (+   717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:25.084194 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:25.084581 (+   387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:25.084589 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.084676 (+    87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:25.085140 (+   464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:25.085152 (+    12us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:25.087053 (+  1901us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20251211 15:03:25.087348 15603 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:25.082678 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:44021 (local address 127.5.160.190:40959)
1211 15:03:25.082776 (+    98us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:25.082780 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:25.082793 (+    13us) server_negotiation.cc:408] Connection header received
1211 15:03:25.082908 (+   115us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:25.082911 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:25.082985 (+    74us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:25.083116 (+   131us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:25.083571 (+   455us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.084039 (+   468us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:25.084711 (+   672us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.084855 (+   144us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:25.087217 (+  2362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:44021: BlockingRecv error: recv got EOF from 127.5.160.131:44021 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Dec 11 15:03:25 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:25 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:25.092903 15604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:25.087896 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:48439)
1211 15:03:25.088013 (+   117us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:25.088028 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:25.088108 (+    80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:25.088373 (+   265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:25.088376 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:25.088614 (+   238us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:25.088780 (+   166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:25.088787 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.089533 (+   746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:25.089536 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:25.089887 (+   351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:25.089905 (+    18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.090001 (+    96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:25.090610 (+   609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:25.090626 (+    16us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:25.092801 (+  2175us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":46}
W20251211 15:03:25.093075 15603 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:25.087998 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:48439 (local address 127.5.160.190:40959)
1211 15:03:25.088193 (+   195us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:25.088196 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:25.088207 (+    11us) server_negotiation.cc:408] Connection header received
1211 15:03:25.088238 (+    31us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:25.088241 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:25.088277 (+    36us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:25.088347 (+    70us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:25.088922 (+   575us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.089427 (+   505us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:25.089997 (+   570us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.090169 (+   172us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:25.092962 (+  2793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:48439: BlockingRecv error: recv got EOF from 127.5.160.131:48439 (error 108)
Metrics: {"server-negotiator.queue_time_us":117}
W20251211 15:03:25.093145 15600 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Dec 11 15:03:25 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:25 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:25.726181 15605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:25.721014 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:36531)
1211 15:03:25.721364 (+   350us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:25.721382 (+    18us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:25.721489 (+   107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:25.721768 (+   279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:25.721771 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:25.721959 (+   188us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:25.722184 (+   225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:25.722190 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.723022 (+   832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:25.723026 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:25.723464 (+   438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:25.723473 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.723568 (+    95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:25.724131 (+   563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:25.724148 (+    17us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:25.726008 (+  1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":144,"threads_started":1}
W20251211 15:03:25.726289 15606 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:25.721063 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:36531 (local address 127.5.160.190:40959)
1211 15:03:25.721406 (+   343us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:25.721411 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:25.721429 (+    18us) server_negotiation.cc:408] Connection header received
1211 15:03:25.721587 (+   158us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:25.721590 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:25.721648 (+    58us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:25.721725 (+    77us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:25.722302 (+   577us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.722869 (+   567us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:25.723572 (+   703us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.723711 (+   139us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:25.726168 (+  2457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:36531: BlockingRecv error: recv got EOF from 127.5.160.129:36531 (error 108)
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":133,"threads_started":1}
Dec 11 15:03:25 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:25 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:25.905083 15607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:25.899479 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:36211)
1211 15:03:25.899836 (+   357us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:25.899853 (+    17us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:25.899976 (+   123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:25.900278 (+   302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:25.900281 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:25.900490 (+   209us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:25.900704 (+   214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:25.900710 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.901649 (+   939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:25.901654 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:25.902232 (+   578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:25.902244 (+    12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.902358 (+   114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:25.903042 (+   684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:25.903086 (+    44us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:25.904957 (+  1871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":127,"threads_started":1}
W20251211 15:03:25.905258 15606 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:25.899648 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:36211 (local address 127.5.160.190:40959)
1211 15:03:25.899836 (+   188us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:25.899841 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:25.899926 (+    85us) server_negotiation.cc:408] Connection header received
1211 15:03:25.900077 (+   151us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:25.900080 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:25.900139 (+    59us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:25.900228 (+    89us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:25.900914 (+   686us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.901510 (+   596us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:25.902391 (+   881us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:25.902583 (+   192us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:25.905135 (+  2552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:36211: BlockingRecv error: recv got EOF from 127.5.160.130:36211 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Dec 11 15:03:26 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:26 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:26.098914 15608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:26.093850 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:52693)
1211 15:03:26.094163 (+   313us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:26.094177 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:26.094288 (+   111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:26.094506 (+   218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:26.094509 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:26.094679 (+   170us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:26.094907 (+   228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:26.094914 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:26.095770 (+   856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:26.095773 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:26.096187 (+   414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:26.096194 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:26.096288 (+    94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:26.096858 (+   570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:26.096872 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:26.098788 (+  1916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":82,"threads_started":1}
W20251211 15:03:26.099247 15606 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:26.093932 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:52693 (local address 127.5.160.190:40959)
1211 15:03:26.094052 (+   120us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:26.094056 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:26.094252 (+   196us) server_negotiation.cc:408] Connection header received
1211 15:03:26.094357 (+   105us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:26.094360 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:26.094414 (+    54us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:26.094482 (+    68us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:26.095149 (+   667us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:26.095654 (+   505us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:26.096324 (+   670us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:26.096474 (+   150us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:26.099120 (+  2646us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:52693: BlockingRecv error: recv got EOF from 127.5.160.131:52693 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Dec 11 15:03:26 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:26 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:26.732779 15609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:26.727206 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:50305)
1211 15:03:26.727482 (+   276us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:26.727496 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:26.727599 (+   103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:26.727916 (+   317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:26.727919 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:26.728151 (+   232us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:26.728390 (+   239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:26.728400 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:26.729390 (+   990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:26.729394 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:26.729859 (+   465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:26.729869 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:26.730014 (+   145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:26.730623 (+   609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:26.730637 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:26.732625 (+  1988us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":86,"threads_started":1}
W20251211 15:03:26.732909 15610 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:26.727415 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:50305 (local address 127.5.160.190:40959)
1211 15:03:26.727667 (+   252us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:26.727670 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:26.727686 (+    16us) server_negotiation.cc:408] Connection header received
1211 15:03:26.727727 (+    41us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:26.727729 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:26.727771 (+    42us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:26.727881 (+   110us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:26.728497 (+   616us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:26.729278 (+   781us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:26.730007 (+   729us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:26.730197 (+   190us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:26.732799 (+  2602us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:50305: BlockingRecv error: recv got EOF from 127.5.160.129:50305 (error 108)
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":73,"threads_started":1}
Dec 11 15:03:26 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:26 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:26.910959 15611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:26.906062 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:55279)
1211 15:03:26.906358 (+   296us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:26.906372 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:26.906485 (+   113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:26.906745 (+   260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:26.906748 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:26.907016 (+   268us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:26.907263 (+   247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:26.907274 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:26.908167 (+   893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:26.908170 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:26.908552 (+   382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:26.908559 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:26.908649 (+    90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:26.909189 (+   540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:26.909202 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:26.910815 (+  1613us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":88,"threads_started":1}
W20251211 15:03:26.911182 15610 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:26.906240 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:55279 (local address 127.5.160.190:40959)
1211 15:03:26.906371 (+   131us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:26.906376 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:26.906437 (+    61us) server_negotiation.cc:408] Connection header received
1211 15:03:26.906568 (+   131us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:26.906571 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:26.906618 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:26.906711 (+    93us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:26.907395 (+   684us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:26.908064 (+   669us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:26.908645 (+   581us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:26.908788 (+   143us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:26.911002 (+  2214us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:55279: BlockingRecv error: recv got EOF from 127.5.160.130:55279 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Dec 11 15:03:27 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:27 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:27.104761 15612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:27.099720 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:39467)
1211 15:03:27.099974 (+   254us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:27.099987 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:27.100085 (+    98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:27.100451 (+   366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:27.100454 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:27.100637 (+   183us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:27.100837 (+   200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:27.100843 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:27.101712 (+   869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:27.101715 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:27.102146 (+   431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:27.102157 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:27.102268 (+   111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:27.102882 (+   614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:27.102896 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:27.104641 (+  1745us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":70,"threads_started":1}
W20251211 15:03:27.104970 15610 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:27.099859 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:39467 (local address 127.5.160.190:40959)
1211 15:03:27.099985 (+   126us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:27.099988 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:27.100037 (+    49us) server_negotiation.cc:408] Connection header received
1211 15:03:27.100218 (+   181us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:27.100221 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:27.100282 (+    61us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:27.100357 (+    75us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:27.100988 (+   631us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:27.101573 (+   585us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:27.102288 (+   715us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:27.102451 (+   163us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:27.104850 (+  2399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:39467: BlockingRecv error: recv got EOF from 127.5.160.131:39467 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Dec 11 15:03:27 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:27 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:27.739168 15613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:27.733723 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:36097)
1211 15:03:27.734078 (+   355us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:27.734094 (+    16us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:27.734273 (+   179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:27.734611 (+   338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:27.734614 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:27.734794 (+   180us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:27.735069 (+   275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:27.735079 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:27.735900 (+   821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:27.735904 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:27.736324 (+   420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:27.736333 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:27.736440 (+   107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:27.736971 (+   531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:27.736985 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:27.738994 (+  2009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":86,"threads_started":1}
W20251211 15:03:27.739292 15614 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:27.733858 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:36097 (local address 127.5.160.190:40959)
1211 15:03:27.734138 (+   280us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:27.734142 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:27.734158 (+    16us) server_negotiation.cc:408] Connection header received
1211 15:03:27.734424 (+   266us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:27.734427 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:27.734479 (+    52us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:27.734574 (+    95us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:27.735224 (+   650us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:27.735770 (+   546us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:27.736438 (+   668us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:27.736578 (+   140us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:27.739176 (+  2598us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:36097: BlockingRecv error: recv got EOF from 127.5.160.129:36097 (error 108)
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":84,"threads_started":1}
Dec 11 15:03:27 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:27 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:27.916913 15615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:27.911810 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:58477)
1211 15:03:27.912180 (+   370us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:27.912198 (+    18us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:27.912332 (+   134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:27.912630 (+   298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:27.912634 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:27.912846 (+   212us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:27.913101 (+   255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:27.913111 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:27.914019 (+   908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:27.914022 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:27.914439 (+   417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:27.914447 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:27.914541 (+    94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:27.915089 (+   548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:27.915102 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:27.916794 (+  1692us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":112,"threads_started":1}
W20251211 15:03:27.917063 15614 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:27.911993 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:58477 (local address 127.5.160.190:40959)
1211 15:03:27.912140 (+   147us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:27.912144 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:27.912283 (+   139us) server_negotiation.cc:408] Connection header received
1211 15:03:27.912453 (+   170us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:27.912457 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:27.912514 (+    57us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:27.912586 (+    72us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:27.913262 (+   676us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:27.913913 (+   651us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:27.914533 (+   620us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:27.914669 (+   136us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:27.916951 (+  2282us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:58477: BlockingRecv error: recv got EOF from 127.5.160.130:58477 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Dec 11 15:03:28 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:28 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:28.110718 15616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:28.105581 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:35645)
1211 15:03:28.105889 (+   308us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:28.105901 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:28.106008 (+   107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:28.106293 (+   285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:28.106296 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:28.106518 (+   222us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:28.106707 (+   189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:28.106714 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:28.107479 (+   765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:28.107482 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:28.107866 (+   384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:28.107872 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:28.107971 (+    99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:28.108680 (+   709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:28.108694 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:28.110597 (+  1903us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":112,"threads_started":1}
W20251211 15:03:28.110865 15614 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:28.105686 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:35645 (local address 127.5.160.190:40959)
1211 15:03:28.105813 (+   127us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:28.105817 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:28.105965 (+   148us) server_negotiation.cc:408] Connection header received
1211 15:03:28.106090 (+   125us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:28.106093 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:28.106141 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:28.106251 (+   110us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:28.106822 (+   571us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:28.107366 (+   544us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:28.107965 (+   599us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:28.108142 (+   177us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:28.110753 (+  2611us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:35645: BlockingRecv error: recv got EOF from 127.5.160.131:35645 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Dec 11 15:03:28 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:28 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:28.745426 15617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:28.740046 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:47291)
1211 15:03:28.740403 (+   357us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:28.740418 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:28.740519 (+   101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:28.740799 (+   280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:28.740802 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:28.741004 (+   202us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:28.741245 (+   241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:28.741254 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:28.742236 (+   982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:28.742239 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:28.742619 (+   380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:28.742625 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:28.742732 (+   107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:28.743372 (+   640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:28.743386 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:28.745305 (+  1919us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":151,"threads_started":1}
W20251211 15:03:28.745638 15618 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:28.740196 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:47291 (local address 127.5.160.190:40959)
1211 15:03:28.740455 (+   259us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:28.740459 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:28.740475 (+    16us) server_negotiation.cc:408] Connection header received
1211 15:03:28.740608 (+   133us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:28.740611 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:28.740657 (+    46us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:28.740736 (+    79us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:28.741366 (+   630us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:28.742057 (+   691us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:28.742738 (+   681us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:28.742922 (+   184us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:28.745505 (+  2583us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:47291: BlockingRecv error: recv got EOF from 127.5.160.129:47291 (error 108)
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":58,"threads_started":1}
Dec 11 15:03:28 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:28 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:28.923235 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:28.917813 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:33973)
1211 15:03:28.918100 (+   287us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:28.918114 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:28.918272 (+   158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:28.918561 (+   289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:28.918564 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:28.918749 (+   185us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:28.918984 (+   235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:28.918994 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:28.919869 (+   875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:28.919873 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:28.920518 (+   645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:28.920530 (+    12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:28.920669 (+   139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:28.921294 (+   625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:28.921308 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:28.923113 (+  1805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":89,"threads_started":1}
W20251211 15:03:28.923417 15618 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:28.917901 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:33973 (local address 127.5.160.190:40959)
1211 15:03:28.918042 (+   141us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:28.918046 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:28.918237 (+   191us) server_negotiation.cc:408] Connection header received
1211 15:03:28.918350 (+   113us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:28.918353 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:28.918408 (+    55us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:28.918491 (+    83us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:28.919188 (+   697us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:28.919740 (+   552us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:28.920674 (+   934us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:28.920884 (+   210us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:28.923266 (+  2382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:33973: BlockingRecv error: recv got EOF from 127.5.160.130:33973 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Dec 11 15:03:29 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:29 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:29.116309 15620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:29.111503 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:51771)
1211 15:03:29.111761 (+   258us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:29.111773 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:29.111869 (+    96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:29.112072 (+   203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:29.112074 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:29.112260 (+   186us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:29.112477 (+   217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:29.112484 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:29.113205 (+   721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:29.113213 (+     8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:29.113638 (+   425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:29.113647 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:29.113748 (+   101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:29.114279 (+   531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:29.114293 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:29.116155 (+  1862us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":87,"threads_started":1}
W20251211 15:03:29.116417 15618 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:29.111569 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:51771 (local address 127.5.160.190:40959)
1211 15:03:29.111707 (+   138us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:29.111710 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:29.111834 (+   124us) server_negotiation.cc:408] Connection header received
1211 15:03:29.111938 (+   104us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:29.111940 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:29.111985 (+    45us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:29.112051 (+    66us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:29.112585 (+   534us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:29.113074 (+   489us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:29.113739 (+   665us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:29.113855 (+   116us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:29.116321 (+  2466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:51771: BlockingRecv error: recv got EOF from 127.5.160.131:51771 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Dec 11 15:03:29 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:29 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:29.755254 15621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:29.746300 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:55727)
1211 15:03:29.746612 (+   312us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:29.746627 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:29.746730 (+   103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:29.747055 (+   325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:29.747057 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:29.747303 (+   246us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:29.747506 (+   203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:29.747513 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:29.748306 (+   793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:29.748310 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:29.748703 (+   393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:29.748710 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:29.748801 (+    91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:29.753097 (+  4296us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:29.753114 (+    17us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:29.755130 (+  2016us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":90,"threads_started":1}
W20251211 15:03:29.755415 15622 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:29.746378 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:55727 (local address 127.5.160.190:40959)
1211 15:03:29.746645 (+   267us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:29.746648 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:29.746701 (+    53us) server_negotiation.cc:408] Connection header received
1211 15:03:29.746861 (+   160us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:29.746865 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:29.746917 (+    52us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:29.747035 (+   118us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:29.747649 (+   614us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:29.748173 (+   524us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:29.748808 (+   635us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:29.748947 (+   139us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:29.755283 (+  6336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:55727: BlockingRecv error: recv got EOF from 127.5.160.129:55727 (error 108)
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":79,"threads_started":1}
Dec 11 15:03:29 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:29 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:29.928764 15623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:29.923995 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:50089)
1211 15:03:29.924298 (+   303us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:29.924315 (+    17us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:29.924427 (+   112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:29.924664 (+   237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:29.924666 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:29.924876 (+   210us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:29.925062 (+   186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:29.925068 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:29.925807 (+   739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:29.925810 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:29.926184 (+   374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:29.926189 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:29.926288 (+    99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:29.926831 (+   543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:29.926844 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:29.928645 (+  1801us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":97,"threads_started":1}
W20251211 15:03:29.928965 15622 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:29.924174 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:50089 (local address 127.5.160.190:40959)
1211 15:03:29.924324 (+   150us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:29.924328 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:29.924373 (+    45us) server_negotiation.cc:408] Connection header received
1211 15:03:29.924511 (+   138us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:29.924515 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:29.924562 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:29.924625 (+    63us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:29.925180 (+   555us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:29.925699 (+   519us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:29.926286 (+   587us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:29.926468 (+   182us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:29.928825 (+  2357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:50089: BlockingRecv error: recv got EOF from 127.5.160.130:50089 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Dec 11 15:03:30 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:30 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:30.122116 15624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:30.117151 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:43771)
1211 15:03:30.117506 (+   355us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:30.117524 (+    18us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:30.117649 (+   125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:30.117914 (+   265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:30.117917 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:30.118133 (+   216us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:30.118326 (+   193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:30.118333 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:30.119121 (+   788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:30.119125 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:30.119513 (+   388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:30.119521 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:30.119627 (+   106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:30.120170 (+   543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:30.120188 (+    18us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:30.121961 (+  1773us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":100,"threads_started":1}
W20251211 15:03:30.122385 15622 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:30.117394 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:43771 (local address 127.5.160.190:40959)
1211 15:03:30.117535 (+   141us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:30.117540 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:30.117592 (+    52us) server_negotiation.cc:408] Connection header received
1211 15:03:30.117748 (+   156us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:30.117752 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:30.117804 (+    52us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:30.117871 (+    67us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:30.118460 (+   589us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:30.118989 (+   529us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:30.119631 (+   642us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:30.119807 (+   176us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:30.122268 (+  2461us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:43771: BlockingRecv error: recv got EOF from 127.5.160.131:43771 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Dec 11 15:03:30 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:30 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:30.761339 15625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:30.756052 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:52933)
1211 15:03:30.756424 (+   372us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:30.756442 (+    18us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:30.756567 (+   125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:30.756882 (+   315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:30.756886 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:30.757076 (+   190us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:30.757329 (+   253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:30.757337 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:30.758116 (+   779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:30.758120 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:30.758568 (+   448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:30.758583 (+    15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:30.758684 (+   101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:30.759267 (+   583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:30.759281 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:30.761169 (+  1888us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":122,"threads_started":1}
W20251211 15:03:30.761497 15626 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:30.756160 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:52933 (local address 127.5.160.190:40959)
1211 15:03:30.756451 (+   291us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:30.756455 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:30.756535 (+    80us) server_negotiation.cc:408] Connection header received
1211 15:03:30.756659 (+   124us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:30.756662 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:30.756711 (+    49us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:30.756794 (+    83us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:30.757475 (+   681us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:30.757995 (+   520us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:30.758696 (+   701us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:30.758840 (+   144us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:30.761338 (+  2498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:52933: BlockingRecv error: recv got EOF from 127.5.160.129:52933 (error 108)
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":60,"threads_started":1}
Dec 11 15:03:30 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:30 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:30.934609 15627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:30.929535 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:46077)
1211 15:03:30.929903 (+   368us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:30.929915 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:30.930012 (+    97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:30.930236 (+   224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:30.930238 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:30.930413 (+   175us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:30.930631 (+   218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:30.930638 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:30.931425 (+   787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:30.931429 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:30.931848 (+   419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:30.931857 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:30.931961 (+   104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:30.932549 (+   588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:30.932564 (+    15us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:30.934468 (+  1904us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":91,"threads_started":1}
W20251211 15:03:30.934777 15626 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:30.929627 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:46077 (local address 127.5.160.190:40959)
1211 15:03:30.929763 (+   136us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:30.929767 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:30.930005 (+   238us) server_negotiation.cc:408] Connection header received
1211 15:03:30.930093 (+    88us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:30.930096 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:30.930145 (+    49us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:30.930211 (+    66us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:30.930737 (+   526us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:30.931292 (+   555us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:30.931982 (+   690us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:30.932129 (+   147us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:30.934646 (+  2517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:46077: BlockingRecv error: recv got EOF from 127.5.160.130:46077 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Dec 11 15:03:31 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:31 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:31.127682 15628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:31.122885 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:33069)
1211 15:03:31.123189 (+   304us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:31.123203 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:31.123310 (+   107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:31.123622 (+   312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:31.123624 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:31.123796 (+   172us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:31.123989 (+   193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:31.123995 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:31.124814 (+   819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:31.124818 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:31.125197 (+   379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:31.125204 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:31.125311 (+   107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:31.125850 (+   539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:31.125863 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:31.127566 (+  1703us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":113,"threads_started":1}
W20251211 15:03:31.127835 15626 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:31.123026 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:33069 (local address 127.5.160.190:40959)
1211 15:03:31.123165 (+   139us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:31.123168 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:31.123277 (+   109us) server_negotiation.cc:408] Connection header received
1211 15:03:31.123444 (+   167us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:31.123447 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:31.123501 (+    54us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:31.123576 (+    75us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:31.124104 (+   528us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:31.124690 (+   586us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:31.125395 (+   705us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:31.125545 (+   150us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:31.127710 (+  2165us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:33069: BlockingRecv error: recv got EOF from 127.5.160.131:33069 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Dec 11 15:03:31 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:31 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:31.767598 15629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:31.762443 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:34395)
1211 15:03:31.762757 (+   314us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:31.762772 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:31.762886 (+   114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:31.763219 (+   333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:31.763222 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:31.763408 (+   186us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:31.763611 (+   203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:31.763617 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:31.764466 (+   849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:31.764469 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:31.764855 (+   386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:31.764863 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:31.764970 (+   107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:31.765578 (+   608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:31.765592 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:31.767441 (+  1849us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":90,"threads_started":1}
W20251211 15:03:31.767704 15630 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:31.762579 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:34395 (local address 127.5.160.190:40959)
1211 15:03:31.762857 (+   278us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:31.762862 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:31.762878 (+    16us) server_negotiation.cc:408] Connection header received
1211 15:03:31.763038 (+   160us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:31.763041 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:31.763096 (+    55us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:31.763173 (+    77us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:31.763734 (+   561us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:31.764357 (+   623us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:31.764960 (+   603us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:31.765141 (+   181us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:31.767591 (+  2450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:34395: BlockingRecv error: recv got EOF from 127.5.160.129:34395 (error 108)
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":77,"threads_started":1}
Dec 11 15:03:31 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:31 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:31.940290 15631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:31.935427 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:38307)
1211 15:03:31.935712 (+   285us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:31.935725 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:31.935831 (+   106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:31.936065 (+   234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:31.936068 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:31.936246 (+   178us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:31.936464 (+   218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:31.936471 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:31.937242 (+   771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:31.937245 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:31.937644 (+   399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:31.937651 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:31.937738 (+    87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:31.938318 (+   580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:31.938346 (+    28us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:31.940123 (+  1777us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":98,"threads_started":1}
W20251211 15:03:31.940393 15630 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:31.935478 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:38307 (local address 127.5.160.190:40959)
1211 15:03:31.935651 (+   173us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:31.935656 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:31.935792 (+   136us) server_negotiation.cc:408] Connection header received
1211 15:03:31.935903 (+   111us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:31.935906 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:31.935953 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:31.936020 (+    67us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:31.936611 (+   591us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:31.937137 (+   526us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:31.937761 (+   624us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:31.937918 (+   157us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:31.940292 (+  2374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:38307: BlockingRecv error: recv got EOF from 127.5.160.130:38307 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Dec 11 15:03:32 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:32 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:32.133695 15632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:32.128539 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:60011)
1211 15:03:32.128845 (+   306us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:32.128859 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:32.128967 (+   108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:32.129211 (+   244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:32.129213 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:32.129390 (+   177us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:32.129606 (+   216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:32.129612 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:32.130363 (+   751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:32.130366 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:32.130775 (+   409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:32.130783 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:32.130880 (+    97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:32.131484 (+   604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:32.131498 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:32.133578 (+  2080us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":87,"threads_started":1}
W20251211 15:03:32.133824 15630 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:32.128684 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:60011 (local address 127.5.160.190:40959)
1211 15:03:32.128850 (+   166us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:32.128854 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:32.128944 (+    90us) server_negotiation.cc:408] Connection header received
1211 15:03:32.129045 (+   101us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:32.129047 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:32.129099 (+    52us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:32.129187 (+    88us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:32.129717 (+   530us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:32.130237 (+   520us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:32.130864 (+   627us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:32.131041 (+   177us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:32.133717 (+  2676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:60011: BlockingRecv error: recv got EOF from 127.5.160.131:60011 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Dec 11 15:03:32 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:32 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:32.773578 15633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:32.768444 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:38887)
1211 15:03:32.768746 (+   302us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:32.768760 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:32.768856 (+    96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:32.769130 (+   274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:32.769133 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:32.769366 (+   233us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:32.769582 (+   216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:32.769589 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:32.770348 (+   759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:32.770351 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:32.770768 (+   417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:32.770777 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:32.770881 (+   104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:32.771519 (+   638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:32.771543 (+    24us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:32.773461 (+  1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":91,"threads_started":1}
W20251211 15:03:32.773788 15634 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:32.768640 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:38887 (local address 127.5.160.190:40959)
1211 15:03:32.768854 (+   214us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:32.768857 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:32.768871 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:03:32.768928 (+    57us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:32.768931 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:32.768974 (+    43us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:32.769046 (+    72us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:32.769688 (+   642us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:32.770224 (+   536us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:32.770860 (+   636us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:32.771045 (+   185us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:32.773658 (+  2613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:38887: BlockingRecv error: recv got EOF from 127.5.160.129:38887 (error 108)
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":63,"threads_started":1}
Dec 11 15:03:32 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:32 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:32.946487 15635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:32.941251 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:39317)
1211 15:03:32.941580 (+   329us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:32.941595 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:32.941712 (+   117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:32.941981 (+   269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:32.941985 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:32.942183 (+   198us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:32.942445 (+   262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:32.942455 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:32.943408 (+   953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:32.943412 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:32.943812 (+   400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:32.943820 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:32.943932 (+   112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:32.944541 (+   609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:32.944556 (+    15us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:32.946369 (+  1813us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":108,"threads_started":1}
W20251211 15:03:32.946657 15634 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:32.941439 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:39317 (local address 127.5.160.190:40959)
1211 15:03:32.941594 (+   155us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:32.941597 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:32.941773 (+   176us) server_negotiation.cc:408] Connection header received
1211 15:03:32.941807 (+    34us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:32.941809 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:32.941856 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:32.941933 (+    77us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:32.942571 (+   638us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:32.943275 (+   704us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:32.943933 (+   658us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:32.944129 (+   196us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:32.946521 (+  2392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:39317: BlockingRecv error: recv got EOF from 127.5.160.130:39317 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Dec 11 15:03:33 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:33 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:33.139402 15636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:33.134454 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:60013)
1211 15:03:33.134769 (+   315us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:33.134783 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:33.134893 (+   110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:33.135168 (+   275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:33.135170 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:33.135488 (+   318us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:33.135700 (+   212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:33.135707 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:33.136453 (+   746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:33.136456 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:33.136836 (+   380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:33.136843 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:33.136938 (+    95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:33.137465 (+   527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:33.137478 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:33.139288 (+  1810us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":104,"threads_started":1}
W20251211 15:03:33.139570 15634 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:33.134569 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:60013 (local address 127.5.160.190:40959)
1211 15:03:33.134730 (+   161us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:33.134734 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:33.134853 (+   119us) server_negotiation.cc:408] Connection header received
1211 15:03:33.135017 (+   164us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:33.135021 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:33.135071 (+    50us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:33.135144 (+    73us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:33.135832 (+   688us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:33.136334 (+   502us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:33.136928 (+   594us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:33.137058 (+   130us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:33.139454 (+  2396us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:60013: BlockingRecv error: recv got EOF from 127.5.160.131:60013 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Dec 11 15:03:33 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:33 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:33.779142 15637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:33.774244 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:39553)
1211 15:03:33.774529 (+   285us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:33.774544 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:33.774643 (+    99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:33.774860 (+   217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:33.774862 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:33.775078 (+   216us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:33.775274 (+   196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:33.775281 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:33.776034 (+   753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:33.776036 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:33.776425 (+   389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:33.776431 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:33.776518 (+    87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:33.777041 (+   523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:33.777055 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:33.779011 (+  1956us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":91,"threads_started":1}
W20251211 15:03:33.779378 15638 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:33.774291 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:39553 (local address 127.5.160.190:40959)
1211 15:03:33.774611 (+   320us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:33.774614 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:33.774628 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:03:33.774717 (+    89us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:33.774719 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:33.774764 (+    45us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:33.774837 (+    73us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:33.775411 (+   574us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:33.775949 (+   538us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:33.776572 (+   623us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:33.776734 (+   162us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:33.779179 (+  2445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:39553: BlockingRecv error: recv got EOF from 127.5.160.129:39553 (error 108)
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":60,"threads_started":1}
Dec 11 15:03:33 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:33 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:33.952505 15639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:33.947408 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:59881)
1211 15:03:33.947735 (+   327us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:33.947748 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:33.947855 (+   107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:33.948095 (+   240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:33.948097 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:33.948277 (+   180us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:33.948469 (+   192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:33.948475 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:33.949238 (+   763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:33.949241 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:33.949673 (+   432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:33.949682 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:33.949780 (+    98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:33.950351 (+   571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:33.950368 (+    17us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:33.952385 (+  2017us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":99,"threads_started":1}
W20251211 15:03:33.952715 15638 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:33.947500 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:59881 (local address 127.5.160.190:40959)
1211 15:03:33.947688 (+   188us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:33.947692 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:33.947842 (+   150us) server_negotiation.cc:408] Connection header received
1211 15:03:33.947935 (+    93us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:33.947938 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:33.947989 (+    51us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:33.948068 (+    79us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:33.948609 (+   541us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:33.949117 (+   508us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:33.949779 (+   662us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:33.949958 (+   179us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:33.952602 (+  2644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:59881: BlockingRecv error: recv got EOF from 127.5.160.130:59881 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Dec 11 15:03:34 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:34 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:34.145090 15640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:34.140161 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:41947)
1211 15:03:34.140452 (+   291us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:34.140465 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:34.140572 (+   107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:34.140830 (+   258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:34.140832 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:34.141006 (+   174us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:34.141198 (+   192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:34.141204 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:34.141913 (+   709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:34.141916 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:34.142337 (+   421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:34.142344 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:34.142445 (+   101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:34.143025 (+   580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:34.143039 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:34.144973 (+  1934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":92,"threads_started":1}
W20251211 15:03:34.145210 15638 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:34.140229 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:41947 (local address 127.5.160.190:40959)
1211 15:03:34.140404 (+   175us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:34.140408 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:34.140535 (+   127us) server_negotiation.cc:408] Connection header received
1211 15:03:34.140668 (+   133us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:34.140671 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:34.140728 (+    57us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:34.140794 (+    66us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:34.141291 (+   497us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:34.141792 (+   501us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:34.142428 (+   636us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:34.142557 (+   129us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:34.145109 (+  2552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:41947: BlockingRecv error: recv got EOF from 127.5.160.131:41947 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Dec 11 15:03:34 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:34 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:34.788125 15641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:34.780041 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:32837)
1211 15:03:34.780314 (+   273us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:34.780328 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:34.780423 (+    95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:34.780717 (+   294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:34.780720 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:34.780924 (+   204us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:34.781123 (+   199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:34.781130 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:34.782018 (+   888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:34.782022 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:34.782479 (+   457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:34.782489 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:34.782590 (+   101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:34.786047 (+  3457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:34.786064 (+    17us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:34.787969 (+  1905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":83,"threads_started":1}
W20251211 15:03:34.788301 15642 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:34.780124 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:32837 (local address 127.5.160.190:40959)
1211 15:03:34.780394 (+   270us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:34.780398 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:34.780416 (+    18us) server_negotiation.cc:408] Connection header received
1211 15:03:34.780515 (+    99us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:34.780517 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:34.780562 (+    45us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:34.780652 (+    90us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:34.781269 (+   617us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:34.781903 (+   634us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:34.782626 (+   723us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:34.782812 (+   186us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:34.788171 (+  5359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:32837: BlockingRecv error: recv got EOF from 127.5.160.129:32837 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":83,"threads_started":1}
Dec 11 15:03:34 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:34 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:34.958880 15643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:34.953317 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:35263)
1211 15:03:34.953579 (+   262us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:34.953592 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:34.953690 (+    98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:34.953961 (+   271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:34.953964 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:34.954148 (+   184us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:34.954348 (+   200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:34.954379 (+    31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:34.955242 (+   863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:34.955245 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:34.955690 (+   445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:34.955700 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:34.955806 (+   106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:34.956556 (+   750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:34.956574 (+    18us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:34.958724 (+  2150us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":81,"threads_started":1}
W20251211 15:03:34.959028 15642 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:34.953445 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:35263 (local address 127.5.160.190:40959)
1211 15:03:34.953596 (+   151us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:34.953600 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:34.953653 (+    53us) server_negotiation.cc:408] Connection header received
1211 15:03:34.953778 (+   125us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:34.953780 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:34.953827 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:34.953888 (+    61us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:34.954508 (+   620us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:34.955110 (+   602us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:34.955810 (+   700us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:34.955957 (+   147us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:34.958883 (+  2926us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:35263: BlockingRecv error: recv got EOF from 127.5.160.130:35263 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Dec 11 15:03:35 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:35 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:35.150952 15644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:35.145914 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:60643)
1211 15:03:35.146193 (+   279us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:35.146205 (+    12us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:35.146291 (+    86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:35.146520 (+   229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:35.146522 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:35.146715 (+   193us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:35.146909 (+   194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:35.146915 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:35.147696 (+   781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:35.147698 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:35.148076 (+   378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:35.148082 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:35.148169 (+    87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:35.148839 (+   670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:35.148853 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:35.150782 (+  1929us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":99,"threads_started":1}
W20251211 15:03:35.151072 15642 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:35.146078 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:60643 (local address 127.5.160.190:40959)
1211 15:03:35.146239 (+   161us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:35.146242 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:35.146259 (+    17us) server_negotiation.cc:408] Connection header received
1211 15:03:35.146372 (+   113us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:35.146375 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:35.146419 (+    44us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:35.146495 (+    76us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:35.147061 (+   566us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:35.147598 (+   537us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:35.148165 (+   567us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:35.148373 (+   208us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:35.150915 (+  2542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:60643: BlockingRecv error: recv got EOF from 127.5.160.131:60643 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Dec 11 15:03:35 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:35 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:35.794492 15645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:35.789147 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:40485)
1211 15:03:35.789484 (+   337us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:35.789498 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:35.789652 (+   154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:35.789925 (+   273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:35.789928 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:35.790168 (+   240us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:35.790593 (+   425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:35.790604 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:35.791423 (+   819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:35.791427 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:35.791844 (+   417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:35.791852 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:35.791951 (+    99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:35.792525 (+   574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:35.792540 (+    15us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:35.794367 (+  1827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":91,"threads_started":1}
W20251211 15:03:35.794656 15646 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:35.789243 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:40485 (local address 127.5.160.190:40959)
1211 15:03:35.789520 (+   277us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:35.789524 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:35.789607 (+    83us) server_negotiation.cc:408] Connection header received
1211 15:03:35.789747 (+   140us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:35.789750 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:35.789799 (+    49us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:35.789881 (+    82us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:35.790737 (+   856us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:35.791309 (+   572us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:35.791972 (+   663us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:35.792125 (+   153us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:35.794515 (+  2390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:40485: BlockingRecv error: recv got EOF from 127.5.160.129:40485 (error 108)
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":56,"threads_started":1}
Dec 11 15:03:35 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:35 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:35.966001 15647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:35.959978 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:59531)
1211 15:03:35.960364 (+   386us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:35.960379 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:35.960506 (+   127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:35.960817 (+   311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:35.960820 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:35.961050 (+   230us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:35.961267 (+   217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:35.961277 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:35.962677 (+  1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:35.962681 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:35.963230 (+   549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:35.963241 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:35.963394 (+   153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:35.963945 (+   551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:35.963962 (+    17us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:35.965863 (+  1901us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":82,"threads_started":1}
W20251211 15:03:35.966117 15646 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:35.960083 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:59531 (local address 127.5.160.190:40959)
1211 15:03:35.960254 (+   171us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:35.960259 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:35.960470 (+   211us) server_negotiation.cc:408] Connection header received
1211 15:03:35.960618 (+   148us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:35.960622 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:35.960687 (+    65us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:35.960776 (+    89us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:35.961400 (+   624us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:35.962520 (+  1120us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:35.963370 (+   850us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:35.963513 (+   143us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:35.966005 (+  2492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:59531: BlockingRecv error: recv got EOF from 127.5.160.130:59531 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Dec 11 15:03:36 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:36 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:36.157131 15648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:36.151810 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:33623)
1211 15:03:36.152080 (+   270us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:36.152094 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:36.152257 (+   163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:36.152520 (+   263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:36.152522 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:36.152707 (+   185us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:36.152924 (+   217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:36.152931 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:36.153764 (+   833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:36.153767 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:36.154162 (+   395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:36.154169 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:36.154276 (+   107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:36.154976 (+   700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:36.154992 (+    16us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:36.157017 (+  2025us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":88,"threads_started":1}
W20251211 15:03:36.157310 15646 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:36.151908 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:33623 (local address 127.5.160.190:40959)
1211 15:03:36.152082 (+   174us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:36.152086 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:36.152210 (+   124us) server_negotiation.cc:408] Connection header received
1211 15:03:36.152347 (+   137us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:36.152350 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:36.152408 (+    58us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:36.152479 (+    71us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:36.153043 (+   564us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:36.153625 (+   582us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:36.154258 (+   633us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:36.154390 (+   132us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:36.157168 (+  2778us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:33623: BlockingRecv error: recv got EOF from 127.5.160.131:33623 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Dec 11 15:03:36 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:36 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:36.799850 15649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:36.795211 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:41391)
1211 15:03:36.795490 (+   279us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:36.795503 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:36.795596 (+    93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:36.795842 (+   246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:36.795844 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:36.796022 (+   178us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:36.796219 (+   197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:36.796224 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:36.796950 (+   726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:36.796953 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:36.797333 (+   380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:36.797339 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:36.797428 (+    89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:36.797952 (+   524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:36.797964 (+    12us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:36.799731 (+  1767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":72,"threads_started":1}
W20251211 15:03:36.799986 15650 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:36.795283 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:41391 (local address 127.5.160.190:40959)
1211 15:03:36.795529 (+   246us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:36.795533 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:36.795546 (+    13us) server_negotiation.cc:408] Connection header received
1211 15:03:36.795686 (+   140us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:36.795689 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:36.795734 (+    45us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:36.795807 (+    73us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:36.796318 (+   511us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:36.796859 (+   541us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:36.797446 (+   587us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:36.797588 (+   142us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:36.799872 (+  2284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:41391: BlockingRecv error: recv got EOF from 127.5.160.129:41391 (error 108)
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":85,"threads_started":1}
Dec 11 15:03:36 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:36 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:36.971827 15651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:36.966789 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:57263)
1211 15:03:36.967090 (+   301us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:36.967105 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:36.967222 (+   117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:36.967476 (+   254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:36.967479 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:36.967694 (+   215us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:36.967891 (+   197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:36.967898 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:36.968819 (+   921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:36.968822 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:36.969242 (+   420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:36.969252 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:36.969392 (+   140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:36.969916 (+   524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:36.969929 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:36.971712 (+  1783us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":81,"threads_started":1}
W20251211 15:03:36.971959 15650 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:36.966893 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:57263 (local address 127.5.160.190:40959)
1211 15:03:36.967079 (+   186us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:36.967084 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:36.967170 (+    86us) server_negotiation.cc:408] Connection header received
1211 15:03:36.967310 (+   140us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:36.967314 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:36.967360 (+    46us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:36.967434 (+    74us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:36.968029 (+   595us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:36.968714 (+   685us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:36.969375 (+   661us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:36.969566 (+   191us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:36.971844 (+  2278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:57263: BlockingRecv error: recv got EOF from 127.5.160.130:57263 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Dec 11 15:03:37 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:37 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:37.162472 15652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:37.157855 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:55419)
1211 15:03:37.158109 (+   254us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:37.158123 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:37.158224 (+   101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:37.158433 (+   209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:37.158435 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:37.158606 (+   171us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:37.158796 (+   190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:37.158801 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:37.159570 (+   769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:37.159573 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:37.159957 (+   384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:37.159964 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:37.160067 (+   103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:37.160634 (+   567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:37.160647 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:37.162317 (+  1670us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":80,"threads_started":1}
W20251211 15:03:37.162554 15650 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:37.157913 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:55419 (local address 127.5.160.190:40959)
1211 15:03:37.158061 (+   148us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:37.158065 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:37.158186 (+   121us) server_negotiation.cc:408] Connection header received
1211 15:03:37.158294 (+   108us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:37.158296 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:37.158344 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:37.158421 (+    77us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:37.158918 (+   497us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:37.159453 (+   535us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:37.160065 (+   612us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:37.160237 (+   172us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:37.162457 (+  2220us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:55419: BlockingRecv error: recv got EOF from 127.5.160.131:55419 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Dec 11 15:03:37 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:37 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:37.805648 15653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:37.800770 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:34135)
1211 15:03:37.801054 (+   284us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:37.801067 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:37.801158 (+    91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:37.801461 (+   303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:37.801463 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:37.801650 (+   187us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:37.801886 (+   236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:37.801893 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:37.802704 (+   811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:37.802707 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:37.803124 (+   417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:37.803132 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:37.803219 (+    87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:37.803780 (+   561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:37.803793 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:37.805513 (+  1720us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":89,"threads_started":1}
W20251211 15:03:37.805837 15654 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:37.800890 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:34135 (local address 127.5.160.190:40959)
1211 15:03:37.801127 (+   237us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:37.801130 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:37.801145 (+    15us) server_negotiation.cc:408] Connection header received
1211 15:03:37.801237 (+    92us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:37.801240 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:37.801344 (+   104us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:37.801441 (+    97us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:37.802017 (+   576us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:37.802580 (+   563us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:37.803232 (+   652us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:37.803379 (+   147us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:37.805700 (+  2321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:34135: BlockingRecv error: recv got EOF from 127.5.160.129:34135 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":76,"threads_started":1}
Dec 11 15:03:37 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:37 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:37.977818 15655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:37.972623 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:47081)
1211 15:03:37.972951 (+   328us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:37.972965 (+    14us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:37.973080 (+   115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:37.973324 (+   244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:37.973326 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:37.973505 (+   179us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:37.973717 (+   212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:37.973724 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:37.974424 (+   700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:37.974427 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:37.974884 (+   457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:37.974894 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:37.975031 (+   137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:37.975714 (+   683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:37.975730 (+    16us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:37.977682 (+  1952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":82,"threads_started":1}
W20251211 15:03:37.977993 15654 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:37.972838 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:47081 (local address 127.5.160.190:40959)
1211 15:03:37.972979 (+   141us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:37.972984 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:37.973036 (+    52us) server_negotiation.cc:408] Connection header received
1211 15:03:37.973170 (+   134us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:37.973173 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:37.973220 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:37.973280 (+    60us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:37.973815 (+   535us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:37.974302 (+   487us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:37.975014 (+   712us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:37.975206 (+   192us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:37.977872 (+  2666us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:47081: BlockingRecv error: recv got EOF from 127.5.160.130:47081 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Dec 11 15:03:38 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:38 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:38.169853 15656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:38.163537 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:44753)
1211 15:03:38.164263 (+   726us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:38.164280 (+    17us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:38.164434 (+   154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:38.164818 (+   384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:38.164822 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:38.165066 (+   244us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:38.165352 (+   286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:38.165362 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:38.166329 (+   967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:38.166334 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:38.166908 (+   574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:38.166920 (+    12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:38.167072 (+   152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:38.167691 (+   619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:38.167711 (+    20us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:38.169735 (+  2024us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":87,"threads_started":1}
W20251211 15:03:38.170025 15654 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:38.163755 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:44753 (local address 127.5.160.190:40959)
1211 15:03:38.164046 (+   291us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:38.164050 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:38.164436 (+   386us) server_negotiation.cc:408] Connection header received
1211 15:03:38.164586 (+   150us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:38.164590 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:38.164652 (+    62us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:38.164790 (+   138us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:38.165483 (+   693us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:38.166190 (+   707us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:38.167055 (+   865us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:38.167246 (+   191us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:38.169903 (+  2657us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:44753: BlockingRecv error: recv got EOF from 127.5.160.131:44753 (error 108)
Metrics: {"server-negotiator.queue_time_us":115}
Dec 11 15:03:38 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:38 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:38.811403 15657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:38.806371 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:54437)
1211 15:03:38.806700 (+   329us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:38.806715 (+    15us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:38.806815 (+   100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:38.807117 (+   302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:38.807120 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:38.807297 (+   177us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:38.807508 (+   211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:38.807515 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:38.808332 (+   817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:38.808336 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:38.808784 (+   448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:38.808793 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:38.808899 (+   106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:38.809499 (+   600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:38.809513 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:38.811277 (+  1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":94,"threads_started":1}
W20251211 15:03:38.811575 15658 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:38.806528 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:54437 (local address 127.5.160.190:40959)
1211 15:03:38.806808 (+   280us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:38.806811 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:38.806825 (+    14us) server_negotiation.cc:408] Connection header received
1211 15:03:38.806886 (+    61us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:38.806889 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:38.806953 (+    64us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:38.807040 (+    87us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:38.807643 (+   603us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:38.808196 (+   553us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:38.808884 (+   688us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:38.809030 (+   146us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:38.811447 (+  2417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:54437: BlockingRecv error: recv got EOF from 127.5.160.129:54437 (error 108)
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":61,"threads_started":1}
Dec 11 15:03:38 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:38 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:38.983510 15659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:38.978581 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:56447)
1211 15:03:38.978890 (+   309us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:38.978907 (+    17us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:38.979063 (+   156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:38.979419 (+   356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:38.979423 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:38.979633 (+   210us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:38.979877 (+   244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:38.979885 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:38.980613 (+   728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:38.980616 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:38.980995 (+   379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:38.981002 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:38.981091 (+    89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:38.981655 (+   564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:38.981670 (+    15us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:38.983363 (+  1693us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":95,"threads_started":1}
W20251211 15:03:38.983631 15658 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:38.978761 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:56447 (local address 127.5.160.190:40959)
1211 15:03:38.978902 (+   141us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:38.978905 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:38.979004 (+    99us) server_negotiation.cc:408] Connection header received
1211 15:03:38.979153 (+   149us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:38.979156 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:38.979206 (+    50us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:38.979299 (+    93us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:38.979987 (+   688us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:38.980498 (+   511us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:38.981090 (+   592us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:38.981224 (+   134us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:38.983530 (+  2306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:56447: BlockingRecv error: recv got EOF from 127.5.160.130:56447 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Dec 11 15:03:39 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:39 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.131@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:39.175410 15660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:39.170671 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.131:42325)
1211 15:03:39.170999 (+   328us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:39.171012 (+    13us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:39.171108 (+    96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:39.171365 (+   257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:39.171368 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:39.171551 (+   183us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:39.171752 (+   201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:39.171759 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:39.172457 (+   698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:39.172460 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:39.172843 (+   383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:39.172850 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:39.172953 (+   103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:39.173504 (+   551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:39.173516 (+    12us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:39.175252 (+  1736us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":105,"threads_started":1}
W20251211 15:03:39.175498 15658 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:39.170772 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:42325 (local address 127.5.160.190:40959)
1211 15:03:39.170898 (+   126us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:39.170901 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:39.171078 (+   177us) server_negotiation.cc:408] Connection header received
1211 15:03:39.171211 (+   133us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:39.171214 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:39.171259 (+    45us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:39.171322 (+    63us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:39.171869 (+   547us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:39.172351 (+   482us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:39.172950 (+   599us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:39.173125 (+   175us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:39.175375 (+  2250us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.131:42325: BlockingRecv error: recv got EOF from 127.5.160.131:42325 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Dec 11 15:03:39 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:39 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.129@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:39.821527 15661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:39.812493 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.129:36171)
1211 15:03:39.812774 (+   281us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:39.812791 (+    17us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:39.812889 (+    98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:39.813255 (+   366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:39.813258 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:39.813468 (+   210us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:39.813672 (+   204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:39.813679 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:39.814570 (+   891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:39.814573 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:39.815012 (+   439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:39.815020 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:39.815127 (+   107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:39.819471 (+  4344us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:39.819489 (+    18us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:39.821404 (+  1915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":86,"threads_started":1}
W20251211 15:03:39.821887 15662 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:39.812697 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:36171 (local address 127.5.160.190:40959)
1211 15:03:39.812968 (+   271us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:39.812973 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:39.812988 (+    15us) server_negotiation.cc:408] Connection header received
1211 15:03:39.813029 (+    41us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:39.813032 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:39.813075 (+    43us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:39.813164 (+    89us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:39.813830 (+   666us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:39.814434 (+   604us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:39.815150 (+   716us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:39.815359 (+   209us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:39.821579 (+  6220us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.129:36171: BlockingRecv error: recv got EOF from 127.5.160.129:36171 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":75,"threads_started":1}
Dec 11 15:03:39 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
Dec 11 15:03:39 dist-test-slave-4k3m krb5kdc[14595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.5.160.130@KRBTEST.COM for oryx/127.5.160.190@KRBTEST.COM, Server not found in Kerberos database
I20251211 15:03:39.988989 15663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:39.984420 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:40959 (local address 127.5.160.130:42677)
1211 15:03:39.984672 (+   252us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:39.984693 (+    21us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:39.984790 (+    97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:39.985013 (+   223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:39.985016 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:39.985191 (+   175us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:39.985389 (+   198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:39.985395 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:39.986081 (+   686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:39.986083 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:39.986464 (+   381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:39.986470 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:39.986556 (+    86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:39.987124 (+   568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:39.987137 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:39.988868 (+  1731us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.160.190:40959: Server oryx/127.5.160.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":73,"threads_started":1}
W20251211 15:03:39.989185 15662 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:39.984516 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:42677 (local address 127.5.160.190:40959)
1211 15:03:39.984691 (+   175us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:39.984695 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:39.984753 (+    58us) server_negotiation.cc:408] Connection header received
1211 15:03:39.984858 (+   105us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:39.984860 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:39.984907 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:39.984972 (+    65us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:39.985484 (+   512us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:39.985995 (+   511us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:39.986556 (+   561us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:39.986716 (+   160us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:39.989061 (+  2345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.160.130:42677: BlockingRecv error: recv got EOF from 127.5.160.130:42677 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20251211 15:03:40.073835  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 15187
I20251211 15:03:40.079137  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 15338
I20251211 15:03:40.084029  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 15471
I20251211 15:03:40.088697  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 15117
2025-12-11T15:03:40Z chronyd exiting
[       OK ] SecurityITest.TestMismatchingPrincipals (18776 ms)
[ RUN      ] SecurityITest.TestRequireAuthenticationInsecureCluster
2025-12-11T15:03:40Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:03:40Z Disabled control of system clock
I20251211 15:03:40.117194  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:39323
--webserver_interface=127.5.160.190
--webserver_port=0
--builtin_ntp_servers=127.5.160.148:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:39323
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20251211 15:03:40.226956 15667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:40.227185 15667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:40.227229 15667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:40.230484 15667 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:03:40.230552 15667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:40.230567 15667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:40.230585 15667 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:03:40.230603 15667 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:03:40.234386 15667 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:39323
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:39323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:40.235487 15667 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:40.236611 15667 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:40.242434 15673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:40.242578 15672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:40.242434 15675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:40.242781 15667 server_base.cc:1047] running on GCE node
I20251211 15:03:40.243270 15667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:40.244197 15667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:40.245354 15667 hybrid_clock.cc:648] HybridClock initialized: now 1765465420245336 us; error 35 us; skew 500 ppm
I20251211 15:03:40.247151 15667 webserver.cc:492] Webserver started at http://127.5.160.190:36319/ using document root <none> and password file <none>
I20251211 15:03:40.247704 15667 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:40.247756 15667 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:40.247939 15667 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:40.249608 15667 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "de4dec570d2d42f78f0ae7d0d154bba7"
format_stamp: "Formatted at 2025-12-11 15:03:40 on dist-test-slave-4k3m"
server_key: "ea58baecf8344ce77f9b42aae6563a9d"
server_key_iv: "fc27cda41daced7d02807a8e66426c08"
server_key_version: "encryptionkey@0"
I20251211 15:03:40.250085 15667 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "de4dec570d2d42f78f0ae7d0d154bba7"
format_stamp: "Formatted at 2025-12-11 15:03:40 on dist-test-slave-4k3m"
server_key: "ea58baecf8344ce77f9b42aae6563a9d"
server_key_iv: "fc27cda41daced7d02807a8e66426c08"
server_key_version: "encryptionkey@0"
I20251211 15:03:40.253453 15667 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20251211 15:03:40.255740 15681 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:40.256814 15667 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20251211 15:03:40.256922 15667 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "de4dec570d2d42f78f0ae7d0d154bba7"
format_stamp: "Formatted at 2025-12-11 15:03:40 on dist-test-slave-4k3m"
server_key: "ea58baecf8344ce77f9b42aae6563a9d"
server_key_iv: "fc27cda41daced7d02807a8e66426c08"
server_key_version: "encryptionkey@0"
I20251211 15:03:40.257026 15667 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:40.271852 15667 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:40.272545 15667 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:40.272727 15667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:40.279776 15667 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:39323
I20251211 15:03:40.279793 15733 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:39323 every 8 connection(s)
I20251211 15:03:40.280781 15667 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:03:40.282245  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 15667
I20251211 15:03:40.282361  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:03:40.282660  5762 external_mini_cluster.cc:1468] Setting key c07290c6d21e66cd55b16880cc7c10b7
I20251211 15:03:40.284010 15734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:40.290045 15734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7: Bootstrap starting.
I20251211 15:03:40.290642 15737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:40.284036 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42016 (local address 127.5.160.190:39323)
1211 15:03:40.284821 (+   785us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:40.284829 (+     8us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:40.284863 (+    34us) server_negotiation.cc:408] Connection header received
1211 15:03:40.285507 (+   644us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:40.285523 (+    16us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:40.285859 (+   336us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:40.286131 (+   272us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:40.286721 (+   590us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:40.287491 (+   770us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:40.288348 (+   857us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:40.288913 (+   565us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:40.289071 (+   158us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:40.289112 (+    41us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:40.289121 (+     9us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:03:40.289489 (+   368us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:40.289527 (+    38us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:03:40.289541 (+    14us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:40.289620 (+    79us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:40.289790 (+   170us) server_negotiation.cc:300] Negotiation successful
1211 15:03:40.290021 (+   231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":144,"threads_started":1}
I20251211 15:03:40.292233 15734 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:40.292927 15734 log.cc:826] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:40.294731 15734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7: No bootstrap required, opened a new log
I20251211 15:03:40.297180 15734 raft_consensus.cc:359] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de4dec570d2d42f78f0ae7d0d154bba7" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 39323 } }
I20251211 15:03:40.297375 15734 raft_consensus.cc:385] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:40.297448 15734 raft_consensus.cc:740] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4dec570d2d42f78f0ae7d0d154bba7, State: Initialized, Role: FOLLOWER
I20251211 15:03:40.297858 15734 consensus_queue.cc:260] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de4dec570d2d42f78f0ae7d0d154bba7" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 39323 } }
I20251211 15:03:40.297981 15734 raft_consensus.cc:399] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:03:40.298040 15734 raft_consensus.cc:493] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:03:40.298125 15734 raft_consensus.cc:3060] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:40.298961 15734 raft_consensus.cc:515] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de4dec570d2d42f78f0ae7d0d154bba7" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 39323 } }
I20251211 15:03:40.299299 15734 leader_election.cc:304] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de4dec570d2d42f78f0ae7d0d154bba7; no voters: 
I20251211 15:03:40.299566 15734 leader_election.cc:290] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:03:40.299716 15739 raft_consensus.cc:2804] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:40.299927 15739 raft_consensus.cc:697] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [term 1 LEADER]: Becoming Leader. State: Replica: de4dec570d2d42f78f0ae7d0d154bba7, State: Running, Role: LEADER
I20251211 15:03:40.300210 15739 consensus_queue.cc:237] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de4dec570d2d42f78f0ae7d0d154bba7" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 39323 } }
I20251211 15:03:40.300647 15734 sys_catalog.cc:565] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:03:40.301735 15741 sys_catalog.cc:455] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader de4dec570d2d42f78f0ae7d0d154bba7. Latest consensus state: current_term: 1 leader_uuid: "de4dec570d2d42f78f0ae7d0d154bba7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de4dec570d2d42f78f0ae7d0d154bba7" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 39323 } } }
I20251211 15:03:40.301867 15741 sys_catalog.cc:458] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:40.302203 15740 sys_catalog.cc:455] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de4dec570d2d42f78f0ae7d0d154bba7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de4dec570d2d42f78f0ae7d0d154bba7" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 39323 } } }
I20251211 15:03:40.302233 15748 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:03:40.302760 15740 sys_catalog.cc:458] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:40.305212 15748 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:03:40.310262 15748 catalog_manager.cc:1357] Generated new cluster ID: 8eb3277a999049959aa1f6df7d6cce58
I20251211 15:03:40.310345 15748 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:03:40.315838 15748 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:03:40.317075 15748 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:03:40.325824 15748 catalog_manager.cc:6027] T 00000000000000000000000000000000 P de4dec570d2d42f78f0ae7d0d154bba7: Generated new TSK 0
I20251211 15:03:40.326732 15748 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 15:03:40.336576  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:39323
--builtin_ntp_servers=127.5.160.148:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20251211 15:03:40.444445 15758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:40.444698 15758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:40.444762 15758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:40.448267 15758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:40.448336 15758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:40.448432 15758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:03:40.452600 15758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:39323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:40.453723 15758 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:40.454851 15758 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:40.461781 15763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:40.461781 15764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:40.461786 15766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:40.462299 15758 server_base.cc:1047] running on GCE node
I20251211 15:03:40.462751 15758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:40.463438 15758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:40.464639 15758 hybrid_clock.cc:648] HybridClock initialized: now 1765465420464616 us; error 36 us; skew 500 ppm
I20251211 15:03:40.466521 15758 webserver.cc:492] Webserver started at http://127.5.160.129:33077/ using document root <none> and password file <none>
I20251211 15:03:40.467125 15758 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:40.467185 15758 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:40.467352 15758 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:40.469081 15758 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "6d1a521af5ad448e9cc09ac8b5b82bfd"
format_stamp: "Formatted at 2025-12-11 15:03:40 on dist-test-slave-4k3m"
server_key: "d2d9d87dd80cee1756af9a52e9f4f1de"
server_key_iv: "da998643079365fb781f860dc472edd9"
server_key_version: "encryptionkey@0"
I20251211 15:03:40.469537 15758 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "6d1a521af5ad448e9cc09ac8b5b82bfd"
format_stamp: "Formatted at 2025-12-11 15:03:40 on dist-test-slave-4k3m"
server_key: "d2d9d87dd80cee1756af9a52e9f4f1de"
server_key_iv: "da998643079365fb781f860dc472edd9"
server_key_version: "encryptionkey@0"
I20251211 15:03:40.472945 15758 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20251211 15:03:40.475273 15772 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:40.476286 15758 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:40.476384 15758 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "6d1a521af5ad448e9cc09ac8b5b82bfd"
format_stamp: "Formatted at 2025-12-11 15:03:40 on dist-test-slave-4k3m"
server_key: "d2d9d87dd80cee1756af9a52e9f4f1de"
server_key_iv: "da998643079365fb781f860dc472edd9"
server_key_version: "encryptionkey@0"
I20251211 15:03:40.476481 15758 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:40.503944 15758 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:40.504551 15758 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:40.504693 15758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:40.505200 15758 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:40.506167 15758 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:40.506217 15758 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:40.506255 15758 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:40.506276 15758 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:40.515002 15758 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:39523
I20251211 15:03:40.515020 15885 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:39523 every 8 connection(s)
I20251211 15:03:40.515967 15758 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:03:40.522980  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 15758
I20251211 15:03:40.523104  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:03:40.523337  5762 external_mini_cluster.cc:1468] Setting key f8f3f257f226c43d7c85b078c3dedbf4
I20251211 15:03:40.523938 15737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:40.517711 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:49997 (local address 127.5.160.190:39323)
1211 15:03:40.517861 (+   150us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:40.517865 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:40.518779 (+   914us) server_negotiation.cc:408] Connection header received
1211 15:03:40.519669 (+   890us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:40.519673 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:40.519758 (+    85us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:40.519828 (+    70us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:40.520816 (+   988us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:40.521314 (+   498us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:40.521963 (+   649us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:40.522145 (+   182us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:40.523436 (+  1291us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:40.523458 (+    22us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:40.523461 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:03:40.523475 (+    14us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:40.523495 (+    20us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:03:40.523503 (+     8us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:40.523564 (+    61us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:40.523732 (+   168us) server_negotiation.cc:300] Negotiation successful
1211 15:03:40.523801 (+    69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20251211 15:03:40.525068  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:39323
--builtin_ntp_servers=127.5.160.148:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20251211 15:03:40.525234 15888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:40.517999 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:39323 (local address 127.5.160.129:49997)
1211 15:03:40.518636 (+   637us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:40.518671 (+    35us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:40.519443 (+   772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:40.520004 (+   561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:40.520012 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:40.520093 (+    81us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:40.520662 (+   569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:40.520674 (+    12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:40.521438 (+   764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:40.521441 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:40.521842 (+   401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:40.521850 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:40.522069 (+   219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:40.523210 (+  1141us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
1211 15:03:40.523212 (+     2us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:40.523247 (+    35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
1211 15:03:40.523303 (+    56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:40.523576 (+   273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:40.523585 (+     9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:40.523590 (+     5us) client_negotiation.cc:769] Sending connection context
1211 15:03:40.523723 (+   133us) client_negotiation.cc:240] Negotiation successful
1211 15:03:40.524627 (+   904us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":103,"threads_started":1}
I20251211 15:03:40.526491 15886 heartbeater.cc:344] Connected to a master server at 127.5.160.190:39323
I20251211 15:03:40.526762 15886 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:40.527421 15886 heartbeater.cc:507] Master 127.5.160.190:39323 requested a full tablet report, sending...
I20251211 15:03:40.528961 15698 ts_manager.cc:194] Registered new tserver with Master: 6d1a521af5ad448e9cc09ac8b5b82bfd (127.5.160.129:39523)
I20251211 15:03:40.530134 15698 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.5.160.129:49997
W20251211 15:03:40.631074 15889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:40.631307 15889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:40.631354 15889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:40.634747 15889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:40.634820 15889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:40.634896 15889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:03:40.638842 15889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:39323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:40.639952 15889 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:40.641058 15889 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:40.647702 15897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:40.647702 15894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:40.647697 15895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:40.648008 15889 server_base.cc:1047] running on GCE node
I20251211 15:03:40.648365 15889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:40.648917 15889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:40.650058 15889 hybrid_clock.cc:648] HybridClock initialized: now 1765465420650045 us; error 33 us; skew 500 ppm
I20251211 15:03:40.651845 15889 webserver.cc:492] Webserver started at http://127.5.160.130:35257/ using document root <none> and password file <none>
I20251211 15:03:40.652393 15889 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:40.652451 15889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:40.652628 15889 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:40.654289 15889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "51cb74a9ba4b4d46bdd450af2dd8515c"
format_stamp: "Formatted at 2025-12-11 15:03:40 on dist-test-slave-4k3m"
server_key: "e44367ad71d48d014b1c81bca3d71a33"
server_key_iv: "d153bc60fcfe744f2b393a85e0de2f76"
server_key_version: "encryptionkey@0"
I20251211 15:03:40.654767 15889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "51cb74a9ba4b4d46bdd450af2dd8515c"
format_stamp: "Formatted at 2025-12-11 15:03:40 on dist-test-slave-4k3m"
server_key: "e44367ad71d48d014b1c81bca3d71a33"
server_key_iv: "d153bc60fcfe744f2b393a85e0de2f76"
server_key_version: "encryptionkey@0"
I20251211 15:03:40.658088 15889 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20251211 15:03:40.660452 15903 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:40.661664 15889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:03:40.661777 15889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "51cb74a9ba4b4d46bdd450af2dd8515c"
format_stamp: "Formatted at 2025-12-11 15:03:40 on dist-test-slave-4k3m"
server_key: "e44367ad71d48d014b1c81bca3d71a33"
server_key_iv: "d153bc60fcfe744f2b393a85e0de2f76"
server_key_version: "encryptionkey@0"
I20251211 15:03:40.661867 15889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:40.681077 15889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:40.681699 15889 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:40.681866 15889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:40.682423 15889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:40.683458 15889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:40.683522 15889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:40.683578 15889 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:40.683601 15889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:40.692458 15889 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:40437
I20251211 15:03:40.692478 16016 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:40437 every 8 connection(s)
I20251211 15:03:40.693426 15889 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:03:40.701098  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 15889
I20251211 15:03:40.701261  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:03:40.701452 15737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:40.695270 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:54751 (local address 127.5.160.190:39323)
1211 15:03:40.695417 (+   147us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:40.695420 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:40.696350 (+   930us) server_negotiation.cc:408] Connection header received
1211 15:03:40.697164 (+   814us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:40.697167 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:40.697219 (+    52us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:40.697280 (+    61us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:40.698256 (+   976us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:40.698784 (+   528us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:40.699416 (+   632us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:40.699575 (+   159us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:40.700836 (+  1261us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:40.700861 (+    25us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:40.700865 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:03:40.700881 (+    16us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:40.700906 (+    25us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:03:40.700916 (+    10us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:40.700993 (+    77us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:40.701208 (+   215us) server_negotiation.cc:300] Negotiation successful
1211 15:03:40.701294 (+    86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20251211 15:03:40.701555  5762 external_mini_cluster.cc:1468] Setting key ce694d875bfea72b6136ab9689fd3019
I20251211 15:03:40.702211 16019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:40.695587 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:39323 (local address 127.5.160.130:54751)
1211 15:03:40.696213 (+   626us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:40.696248 (+    35us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:40.696977 (+   729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:40.697434 (+   457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:40.697443 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:40.697535 (+    92us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:40.698117 (+   582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:40.698128 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:40.698896 (+   768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:40.698899 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:40.699324 (+   425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:40.699331 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:40.699523 (+   192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:40.700574 (+  1051us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
1211 15:03:40.700576 (+     2us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:40.700613 (+    37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
1211 15:03:40.700676 (+    63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:40.701011 (+   335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:40.701018 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:40.701023 (+     5us) client_negotiation.cc:769] Sending connection context
1211 15:03:40.701179 (+   156us) client_negotiation.cc:240] Negotiation successful
1211 15:03:40.701444 (+   265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":106,"threads_started":1}
I20251211 15:03:40.703279 16017 heartbeater.cc:344] Connected to a master server at 127.5.160.190:39323
I20251211 15:03:40.703539 16017 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:40.703552  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:39323
--builtin_ntp_servers=127.5.160.148:38993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20251211 15:03:40.704125 16017 heartbeater.cc:507] Master 127.5.160.190:39323 requested a full tablet report, sending...
I20251211 15:03:40.705171 15698 ts_manager.cc:194] Registered new tserver with Master: 51cb74a9ba4b4d46bdd450af2dd8515c (127.5.160.130:40437)
I20251211 15:03:40.705762 15698 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.5.160.130:54751
W20251211 15:03:40.810593 16020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:40.810837 16020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:40.810889 16020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:40.814254 16020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:40.814332 16020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:40.814420 16020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:03:40.818492 16020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:38993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:39323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:40.819646 16020 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:40.820772 16020 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:40.827617 16025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:40.827620 16028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:40.827620 16026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:40.827792 16020 server_base.cc:1047] running on GCE node
I20251211 15:03:40.828438 16020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:40.828976 16020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:40.830127 16020 hybrid_clock.cc:648] HybridClock initialized: now 1765465420830113 us; error 29 us; skew 500 ppm
I20251211 15:03:40.831979 16020 webserver.cc:492] Webserver started at http://127.5.160.131:33705/ using document root <none> and password file <none>
I20251211 15:03:40.832523 16020 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:40.832576 16020 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:40.832738 16020 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:40.834520 16020 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "a8f04eae5ec748ab867eff4332dc62ee"
format_stamp: "Formatted at 2025-12-11 15:03:40 on dist-test-slave-4k3m"
server_key: "bfe62b44e8554755d06581a1f69bc9ca"
server_key_iv: "1611da5e92cc8e92092348d35c9982b4"
server_key_version: "encryptionkey@0"
I20251211 15:03:40.835090 16020 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "a8f04eae5ec748ab867eff4332dc62ee"
format_stamp: "Formatted at 2025-12-11 15:03:40 on dist-test-slave-4k3m"
server_key: "bfe62b44e8554755d06581a1f69bc9ca"
server_key_iv: "1611da5e92cc8e92092348d35c9982b4"
server_key_version: "encryptionkey@0"
I20251211 15:03:40.838546 16020 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20251211 15:03:40.840878 16034 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:40.841995 16020 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:40.842103 16020 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "a8f04eae5ec748ab867eff4332dc62ee"
format_stamp: "Formatted at 2025-12-11 15:03:40 on dist-test-slave-4k3m"
server_key: "bfe62b44e8554755d06581a1f69bc9ca"
server_key_iv: "1611da5e92cc8e92092348d35c9982b4"
server_key_version: "encryptionkey@0"
I20251211 15:03:40.842198 16020 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:40.863759 16020 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:40.864362 16020 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:40.864516 16020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:40.865113 16020 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:40.866117 16020 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:40.866166 16020 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:40.866210 16020 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:40.866237 16020 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:40.874703 16020 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:37821
I20251211 15:03:40.874745 16147 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:37821 every 8 connection(s)
I20251211 15:03:40.875718 16020 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
I20251211 15:03:40.879220  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 16020
I20251211 15:03:40.879340  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:03:40.879602  5762 external_mini_cluster.cc:1468] Setting key 95cc016ec27f6d7ffa4fab8bdcb1e3e0
I20251211 15:03:40.884045 15737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:40.877587 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:34773 (local address 127.5.160.190:39323)
1211 15:03:40.877722 (+   135us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:40.877727 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:40.878601 (+   874us) server_negotiation.cc:408] Connection header received
1211 15:03:40.879571 (+   970us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:40.879580 (+     9us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:40.879637 (+    57us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:40.879735 (+    98us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:40.880982 (+  1247us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:40.881495 (+   513us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:40.882137 (+   642us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:40.882312 (+   175us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:40.883565 (+  1253us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:40.883582 (+    17us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:40.883585 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:03:40.883596 (+    11us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:40.883617 (+    21us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:03:40.883630 (+    13us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:40.883689 (+    59us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:40.883844 (+   155us) server_negotiation.cc:300] Negotiation successful
1211 15:03:40.883907 (+    63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20251211 15:03:40.884670 16150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:40.877867 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:39323 (local address 127.5.160.131:34773)
1211 15:03:40.878463 (+   596us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:40.878502 (+    39us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:40.879353 (+   851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:40.879913 (+   560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:40.879922 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:40.880010 (+    88us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:40.880835 (+   825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:40.880850 (+    15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:40.881619 (+   769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:40.881622 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:40.882023 (+   401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:40.882030 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:40.882229 (+   199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:40.883298 (+  1069us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
1211 15:03:40.883300 (+     2us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:40.883330 (+    30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
1211 15:03:40.883434 (+   104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:40.883699 (+   265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:40.883707 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:40.883713 (+     6us) client_negotiation.cc:769] Sending connection context
1211 15:03:40.883840 (+   127us) client_negotiation.cc:240] Negotiation successful
1211 15:03:40.884067 (+   227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":96,"threads_started":1}
I20251211 15:03:40.885607 16148 heartbeater.cc:344] Connected to a master server at 127.5.160.190:39323
I20251211 15:03:40.885836 16148 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:40.886358 16148 heartbeater.cc:507] Master 127.5.160.190:39323 requested a full tablet report, sending...
I20251211 15:03:40.887372 15698 ts_manager.cc:194] Registered new tserver with Master: a8f04eae5ec748ab867eff4332dc62ee (127.5.160.131:37821)
I20251211 15:03:40.887925 15698 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.5.160.131:34773
I20251211 15:03:40.893018  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
W20251211 15:03:40.895687 15737 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:40.894764 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42026 (local address 127.5.160.190:39323)
1211 15:03:40.894956 (+   192us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:40.894961 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:40.895054 (+    93us) server_negotiation.cc:408] Connection header received
1211 15:03:40.895191 (+   137us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:40.895194 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:40.895241 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:40.895321 (+    80us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:40.895549 (+   228us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42026: BlockingRecv error: recv got EOF from 127.0.0.1:42026 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20251211 15:03:40.895768  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 15758
I20251211 15:03:40.901119  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 15889
I20251211 15:03:40.906153  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 16020
I20251211 15:03:40.911062  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 15667
2025-12-11T15:03:40Z chronyd exiting
[       OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (821 ms)
[ RUN      ] SecurityITest.TestRequireEncryptionInsecureCluster
2025-12-11T15:03:40Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:03:40Z Disabled control of system clock
I20251211 15:03:40.937984  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:37037
--webserver_interface=127.5.160.190
--webserver_port=0
--builtin_ntp_servers=127.5.160.148:39691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:37037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20251211 15:03:41.045200 16159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:41.045444 16159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:41.045492 16159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:41.048859 16159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:03:41.048928 16159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:41.048942 16159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:41.048961 16159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:03:41.048977 16159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:03:41.053071 16159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:39691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:37037
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:37037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:41.054162 16159 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:41.055266 16159 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:41.060928 16164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:41.060925 16167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:41.060928 16165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:41.061178 16159 server_base.cc:1047] running on GCE node
I20251211 15:03:41.061667 16159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:41.062600 16159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:41.063742 16159 hybrid_clock.cc:648] HybridClock initialized: now 1765465421063727 us; error 35 us; skew 500 ppm
I20251211 15:03:41.065567 16159 webserver.cc:492] Webserver started at http://127.5.160.190:42119/ using document root <none> and password file <none>
I20251211 15:03:41.066114 16159 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:41.066172 16159 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:41.066345 16159 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:41.068085 16159 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "fb8892901bce4208975c82a7728d5a16"
format_stamp: "Formatted at 2025-12-11 15:03:41 on dist-test-slave-4k3m"
server_key: "fb720b4606f8e79100cdba4791ffa478"
server_key_iv: "1dfe1a359d145fbcc4b7bd75b30cbf99"
server_key_version: "encryptionkey@0"
I20251211 15:03:41.068562 16159 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "fb8892901bce4208975c82a7728d5a16"
format_stamp: "Formatted at 2025-12-11 15:03:41 on dist-test-slave-4k3m"
server_key: "fb720b4606f8e79100cdba4791ffa478"
server_key_iv: "1dfe1a359d145fbcc4b7bd75b30cbf99"
server_key_version: "encryptionkey@0"
I20251211 15:03:41.072002 16159 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20251211 15:03:41.074308 16173 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:41.075388 16159 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:41.075505 16159 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "fb8892901bce4208975c82a7728d5a16"
format_stamp: "Formatted at 2025-12-11 15:03:41 on dist-test-slave-4k3m"
server_key: "fb720b4606f8e79100cdba4791ffa478"
server_key_iv: "1dfe1a359d145fbcc4b7bd75b30cbf99"
server_key_version: "encryptionkey@0"
I20251211 15:03:41.075599 16159 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:41.080348 16159 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:41.080938 16159 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:41.081085 16159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:41.087816 16225 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:37037 every 8 connection(s)
I20251211 15:03:41.087826 16159 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:37037
I20251211 15:03:41.088901 16159 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:03:41.091842 16226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:41.092972  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 16159
I20251211 15:03:41.093092  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:03:41.093330  5762 external_mini_cluster.cc:1468] Setting key d158216c2cd2cdbb2ae7906dbbd58e52
I20251211 15:03:41.098047 16226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16: Bootstrap starting.
I20251211 15:03:41.098290 16229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:41.094620 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37018 (local address 127.5.160.190:37037)
1211 15:03:41.095272 (+   652us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:41.095280 (+     8us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:41.095313 (+    33us) server_negotiation.cc:408] Connection header received
1211 15:03:41.095828 (+   515us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:41.095844 (+    16us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:41.096144 (+   300us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:41.096440 (+   296us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:41.097206 (+   766us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:41.097211 (+     5us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:41.097220 (+     9us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:03:41.097230 (+    10us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:41.097269 (+    39us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:03:41.097280 (+    11us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:41.097406 (+   126us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:41.097502 (+    96us) server_negotiation.cc:300] Negotiation successful
1211 15:03:41.097710 (+   208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":127,"threads_started":1}
I20251211 15:03:41.100198 16226 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:41.100921 16226 log.cc:826] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:41.102641 16226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16: No bootstrap required, opened a new log
I20251211 15:03:41.105113 16226 raft_consensus.cc:359] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb8892901bce4208975c82a7728d5a16" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37037 } }
I20251211 15:03:41.105312 16226 raft_consensus.cc:385] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:41.105348 16226 raft_consensus.cc:740] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb8892901bce4208975c82a7728d5a16, State: Initialized, Role: FOLLOWER
I20251211 15:03:41.105809 16226 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb8892901bce4208975c82a7728d5a16" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37037 } }
I20251211 15:03:41.105959 16226 raft_consensus.cc:399] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:03:41.106024 16226 raft_consensus.cc:493] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:03:41.106117 16226 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:41.107023 16226 raft_consensus.cc:515] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb8892901bce4208975c82a7728d5a16" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37037 } }
I20251211 15:03:41.107352 16226 leader_election.cc:304] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb8892901bce4208975c82a7728d5a16; no voters: 
I20251211 15:03:41.107633 16226 leader_election.cc:290] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:03:41.107738 16231 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:41.107949 16231 raft_consensus.cc:697] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [term 1 LEADER]: Becoming Leader. State: Replica: fb8892901bce4208975c82a7728d5a16, State: Running, Role: LEADER
I20251211 15:03:41.108263 16231 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb8892901bce4208975c82a7728d5a16" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37037 } }
I20251211 15:03:41.108819 16226 sys_catalog.cc:565] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:03:41.109805 16233 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb8892901bce4208975c82a7728d5a16. Latest consensus state: current_term: 1 leader_uuid: "fb8892901bce4208975c82a7728d5a16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb8892901bce4208975c82a7728d5a16" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37037 } } }
I20251211 15:03:41.109920 16233 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:41.110270 16240 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:03:41.110955 16232 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb8892901bce4208975c82a7728d5a16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb8892901bce4208975c82a7728d5a16" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 37037 } } }
I20251211 15:03:41.111060 16232 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:41.113173 16240 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:03:41.118211 16240 catalog_manager.cc:1357] Generated new cluster ID: 19ae7167c2b147dba55da3de36315065
I20251211 15:03:41.118283 16240 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:03:41.139928 16240 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:03:41.140259 16240 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:03:41.145845 16240 catalog_manager.cc:6027] T 00000000000000000000000000000000 P fb8892901bce4208975c82a7728d5a16: Generated new TSK 0
I20251211 15:03:41.146580 16240 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 15:03:41.153195  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:37037
--builtin_ntp_servers=127.5.160.148:39691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20251211 15:03:41.261255 16250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:41.261474 16250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:41.261557 16250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:41.264881 16250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:41.264940 16250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:41.265019 16250 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:03:41.268947 16250 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:39691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:37037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:41.270031 16250 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:41.271193 16250 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:41.277658 16256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:41.277753 16258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:41.277648 16255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:41.278060 16250 server_base.cc:1047] running on GCE node
I20251211 15:03:41.278401 16250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:41.278976 16250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:41.280134 16250 hybrid_clock.cc:648] HybridClock initialized: now 1765465421280111 us; error 40 us; skew 500 ppm
I20251211 15:03:41.281925 16250 webserver.cc:492] Webserver started at http://127.5.160.129:41475/ using document root <none> and password file <none>
I20251211 15:03:41.282485 16250 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:41.282543 16250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:41.282718 16250 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:41.284402 16250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "8b2ec9e779d54e9b96dbe9ee7175e137"
format_stamp: "Formatted at 2025-12-11 15:03:41 on dist-test-slave-4k3m"
server_key: "86d18489580970f8ab70350d8c612ccb"
server_key_iv: "564ec4d81c4fefc6ebbc294e06b8e81e"
server_key_version: "encryptionkey@0"
I20251211 15:03:41.284863 16250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "8b2ec9e779d54e9b96dbe9ee7175e137"
format_stamp: "Formatted at 2025-12-11 15:03:41 on dist-test-slave-4k3m"
server_key: "86d18489580970f8ab70350d8c612ccb"
server_key_iv: "564ec4d81c4fefc6ebbc294e06b8e81e"
server_key_version: "encryptionkey@0"
I20251211 15:03:41.288141 16250 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20251211 15:03:41.290352 16264 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:41.291409 16250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:41.291540 16250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "8b2ec9e779d54e9b96dbe9ee7175e137"
format_stamp: "Formatted at 2025-12-11 15:03:41 on dist-test-slave-4k3m"
server_key: "86d18489580970f8ab70350d8c612ccb"
server_key_iv: "564ec4d81c4fefc6ebbc294e06b8e81e"
server_key_version: "encryptionkey@0"
I20251211 15:03:41.291632 16250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:41.296240 16250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:41.296839 16250 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:41.296995 16250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:41.297504 16250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:41.298447 16250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:41.298506 16250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:41.298557 16250 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:41.298581 16250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:41.307204 16250 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:38549
I20251211 15:03:41.307237 16377 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:38549 every 8 connection(s)
I20251211 15:03:41.308194 16250 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:03:41.308583  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 16250
I20251211 15:03:41.308712  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:03:41.308982  5762 external_mini_cluster.cc:1468] Setting key acfbaea372235ad2815a1f27a64b06e1
I20251211 15:03:41.311147  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:37037
--builtin_ntp_servers=127.5.160.148:39691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20251211 15:03:41.313783 16229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:41.310058 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:45059 (local address 127.5.160.190:37037)
1211 15:03:41.310194 (+   136us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:41.310198 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:41.311285 (+  1087us) server_negotiation.cc:408] Connection header received
1211 15:03:41.312168 (+   883us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:41.312172 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:41.312220 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:41.312292 (+    72us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:41.313337 (+  1045us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:41.313341 (+     4us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:41.313343 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:03:41.313355 (+    12us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:41.313375 (+    20us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:03:41.313383 (+     8us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:41.313470 (+    87us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:41.313600 (+   130us) server_negotiation.cc:300] Negotiation successful
1211 15:03:41.313646 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20251211 15:03:41.314515 16380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:41.310409 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:37037 (local address 127.5.160.129:45059)
1211 15:03:41.311163 (+   754us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:41.311198 (+    35us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:41.311970 (+   772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:41.312452 (+   482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:41.312462 (+    10us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:41.312551 (+    89us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:41.313116 (+   565us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
1211 15:03:41.313117 (+     1us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:41.313149 (+    32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
1211 15:03:41.313202 (+    53us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:41.313456 (+   254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:41.313465 (+     9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:41.313470 (+     5us) client_negotiation.cc:769] Sending connection context
1211 15:03:41.313661 (+   191us) client_negotiation.cc:240] Negotiation successful
1211 15:03:41.313916 (+   255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":126,"threads_started":1}
I20251211 15:03:41.315691 16378 heartbeater.cc:344] Connected to a master server at 127.5.160.190:37037
I20251211 15:03:41.315927 16378 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:41.316330 16378 heartbeater.cc:507] Master 127.5.160.190:37037 requested a full tablet report, sending...
I20251211 15:03:41.317970 16190 ts_manager.cc:194] Registered new tserver with Master: 8b2ec9e779d54e9b96dbe9ee7175e137 (127.5.160.129:38549)
W20251211 15:03:41.418779 16381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:41.419060 16381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:41.419119 16381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:41.422405 16381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:41.422472 16381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:41.422557 16381 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:03:41.426553 16381 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:39691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:37037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:41.427693 16381 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:41.428781 16381 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:41.435595 16386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:41.435706 16387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:41.435595 16389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:41.436035 16381 server_base.cc:1047] running on GCE node
I20251211 15:03:41.436417 16381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:41.436981 16381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:41.438133 16381 hybrid_clock.cc:648] HybridClock initialized: now 1765465421438112 us; error 33 us; skew 500 ppm
I20251211 15:03:41.439936 16381 webserver.cc:492] Webserver started at http://127.5.160.130:42767/ using document root <none> and password file <none>
I20251211 15:03:41.440483 16381 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:41.440546 16381 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:41.440721 16381 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:41.442392 16381 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "60cdd4a1dfef4ae5a0a03e4785989f1a"
format_stamp: "Formatted at 2025-12-11 15:03:41 on dist-test-slave-4k3m"
server_key: "781704f0e6be4f25503f36d4d0b8cd60"
server_key_iv: "aa977e6f168fa772ebaa1bc481be4fee"
server_key_version: "encryptionkey@0"
I20251211 15:03:41.442859 16381 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "60cdd4a1dfef4ae5a0a03e4785989f1a"
format_stamp: "Formatted at 2025-12-11 15:03:41 on dist-test-slave-4k3m"
server_key: "781704f0e6be4f25503f36d4d0b8cd60"
server_key_iv: "aa977e6f168fa772ebaa1bc481be4fee"
server_key_version: "encryptionkey@0"
I20251211 15:03:41.446202 16381 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20251211 15:03:41.448426 16395 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:41.449431 16381 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:03:41.449537 16381 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "60cdd4a1dfef4ae5a0a03e4785989f1a"
format_stamp: "Formatted at 2025-12-11 15:03:41 on dist-test-slave-4k3m"
server_key: "781704f0e6be4f25503f36d4d0b8cd60"
server_key_iv: "aa977e6f168fa772ebaa1bc481be4fee"
server_key_version: "encryptionkey@0"
I20251211 15:03:41.449630 16381 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:41.454291 16381 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:41.454867 16381 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:41.455045 16381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:41.455542 16381 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:41.456506 16381 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:41.456553 16381 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:41.456604 16381 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:41.456630 16381 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:41.465286 16381 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:34055
I20251211 15:03:41.465317 16508 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:34055 every 8 connection(s)
I20251211 15:03:41.466224 16381 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:03:41.466661  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 16381
I20251211 15:03:41.466784  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:03:41.467061  5762 external_mini_cluster.cc:1468] Setting key 523d2edacc94650f7a151cfefa92e74a
I20251211 15:03:41.469326  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:37037
--builtin_ntp_servers=127.5.160.148:39691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20251211 15:03:41.471896 16229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:41.468087 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:57747 (local address 127.5.160.190:37037)
1211 15:03:41.468233 (+   146us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:41.468239 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:41.469199 (+   960us) server_negotiation.cc:408] Connection header received
1211 15:03:41.470087 (+   888us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:41.470091 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:41.470136 (+    45us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:41.470210 (+    74us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:41.471407 (+  1197us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:41.471410 (+     3us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:41.471414 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:03:41.471428 (+    14us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:41.471453 (+    25us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:03:41.471462 (+     9us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:41.471553 (+    91us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:41.471718 (+   165us) server_negotiation.cc:300] Negotiation successful
1211 15:03:41.471761 (+    43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20251211 15:03:41.472610 16511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:41.468353 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:37037 (local address 127.5.160.130:57747)
1211 15:03:41.469064 (+   711us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:41.469104 (+    40us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:41.469881 (+   777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:41.470384 (+   503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:41.470400 (+    16us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:41.470487 (+    87us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:41.471152 (+   665us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
1211 15:03:41.471154 (+     2us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:41.471185 (+    31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
1211 15:03:41.471239 (+    54us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:41.471563 (+   324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:41.471571 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:41.471576 (+     5us) client_negotiation.cc:769] Sending connection context
1211 15:03:41.471788 (+   212us) client_negotiation.cc:240] Negotiation successful
1211 15:03:41.471976 (+   188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":146,"threads_started":1}
I20251211 15:03:41.473810 16509 heartbeater.cc:344] Connected to a master server at 127.5.160.190:37037
I20251211 15:03:41.474057 16509 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:41.474469 16509 heartbeater.cc:507] Master 127.5.160.190:37037 requested a full tablet report, sending...
I20251211 15:03:41.475523 16190 ts_manager.cc:194] Registered new tserver with Master: 60cdd4a1dfef4ae5a0a03e4785989f1a (127.5.160.130:34055)
W20251211 15:03:41.577186 16512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:41.577421 16512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:41.577499 16512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:41.580905 16512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:41.580969 16512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:41.581065 16512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:03:41.585018 16512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:39691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:37037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:41.586143 16512 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:41.587309 16512 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:41.593988 16517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:41.593962 16518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:41.594156 16512 server_base.cc:1047] running on GCE node
W20251211 15:03:41.594266 16520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:41.594770 16512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:41.595376 16512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:41.596541 16512 hybrid_clock.cc:648] HybridClock initialized: now 1765465421596502 us; error 87 us; skew 500 ppm
I20251211 15:03:41.598500 16512 webserver.cc:492] Webserver started at http://127.5.160.131:42599/ using document root <none> and password file <none>
I20251211 15:03:41.599108 16512 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:41.599172 16512 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:41.599362 16512 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:41.601089 16512 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "42c3903b54c144f296615c2d44f48b08"
format_stamp: "Formatted at 2025-12-11 15:03:41 on dist-test-slave-4k3m"
server_key: "8b19b4641f54aa0cad2348b339ecdfea"
server_key_iv: "e1242e0ae276688307508480b4d6c0e5"
server_key_version: "encryptionkey@0"
I20251211 15:03:41.601564 16512 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "42c3903b54c144f296615c2d44f48b08"
format_stamp: "Formatted at 2025-12-11 15:03:41 on dist-test-slave-4k3m"
server_key: "8b19b4641f54aa0cad2348b339ecdfea"
server_key_iv: "e1242e0ae276688307508480b4d6c0e5"
server_key_version: "encryptionkey@0"
I20251211 15:03:41.605026 16512 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.002s
I20251211 15:03:41.607293 16526 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:41.608333 16512 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:41.608448 16512 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "42c3903b54c144f296615c2d44f48b08"
format_stamp: "Formatted at 2025-12-11 15:03:41 on dist-test-slave-4k3m"
server_key: "8b19b4641f54aa0cad2348b339ecdfea"
server_key_iv: "e1242e0ae276688307508480b4d6c0e5"
server_key_version: "encryptionkey@0"
I20251211 15:03:41.608557 16512 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:41.613636 16512 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:41.614236 16512 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:41.614394 16512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:41.614984 16512 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:41.615948 16512 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:41.615996 16512 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:41.616047 16512 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:41.616073 16512 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:41.624555 16512 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:38819
I20251211 15:03:41.624591 16639 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:38819 every 8 connection(s)
I20251211 15:03:41.625470 16512 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
I20251211 15:03:41.630586 16229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:41.627170 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:40705 (local address 127.5.160.190:37037)
1211 15:03:41.627311 (+   141us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:41.627315 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:41.628193 (+   878us) server_negotiation.cc:408] Connection header received
1211 15:03:41.628991 (+   798us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:41.628995 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:41.629043 (+    48us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:41.629114 (+    71us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:41.630117 (+  1003us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:41.630121 (+     4us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:41.630124 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: PLAIN
1211 15:03:41.630135 (+    11us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:41.630156 (+    21us) server_negotiation.cc:1092] Received PLAIN auth, user=slave
1211 15:03:41.630164 (+     8us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:41.630258 (+    94us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:41.630395 (+   137us) server_negotiation.cc:300] Negotiation successful
1211 15:03:41.630442 (+    47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20251211 15:03:41.631326 16642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:41.627458 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:37037 (local address 127.5.160.131:40705)
1211 15:03:41.628054 (+   596us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:41.628088 (+    34us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:41.628795 (+   707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:41.629273 (+   478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:41.629281 (+     8us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:41.629364 (+    83us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:41.629885 (+   521us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
1211 15:03:41.629886 (+     1us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:41.629916 (+    30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
1211 15:03:41.629970 (+    54us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:41.630239 (+   269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:41.630258 (+    19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:41.630263 (+     5us) client_negotiation.cc:769] Sending connection context
1211 15:03:41.630452 (+   189us) client_negotiation.cc:240] Negotiation successful
1211 15:03:41.630660 (+   208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":94,"threads_started":1}
I20251211 15:03:41.632262 16640 heartbeater.cc:344] Connected to a master server at 127.5.160.190:37037
I20251211 15:03:41.632464 16640 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:41.632840 16640 heartbeater.cc:507] Master 127.5.160.190:37037 requested a full tablet report, sending...
I20251211 15:03:41.633742 16190 ts_manager.cc:194] Registered new tserver with Master: 42c3903b54c144f296615c2d44f48b08 (127.5.160.131:38819)
I20251211 15:03:41.635362  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 16512
I20251211 15:03:41.635460  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:03:41.635684  5762 external_mini_cluster.cc:1468] Setting key a1339e4e357e80268709629913c6f5c0
I20251211 15:03:41.637393  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
W20251211 15:03:41.639953 16229 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:03:41.639153 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37022 (local address 127.5.160.190:37037)
1211 15:03:41.639292 (+   139us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:41.639297 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:41.639396 (+    99us) server_negotiation.cc:408] Connection header received
1211 15:03:41.639521 (+   125us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:41.639525 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:41.639562 (+    37us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:41.639622 (+    60us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:41.639835 (+   213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37022: BlockingRecv error: recv got EOF from 127.0.0.1:37022 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20251211 15:03:41.640069  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 16250
I20251211 15:03:41.645639  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 16381
I20251211 15:03:41.650683  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 16512
I20251211 15:03:41.655364  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 16159
2025-12-11T15:03:41Z chronyd exiting
[       OK ] SecurityITest.TestRequireEncryptionInsecureCluster (743 ms)
[ RUN      ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:03:41 dist-test-slave-4k3m krb5kdc[16650](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:03:41 dist-test-slave-4k3m krb5kdc[16650](info): set up 2 sockets
Dec 11 15:03:41 dist-test-slave-4k3m krb5kdc[16650](info): commencing operation
krb5kdc: starting...
W20251211 15:03:43.495626  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.820s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:03:43 dist-test-slave-4k3m krb5kdc[16650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:03:43Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:03:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:03:43.633539  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:36941
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:39467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:36941
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:43.739979 16666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:43.740250 16666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:43.740309 16666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:43.743734 16666 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:03:43.743844 16666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:43.743873 16666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:43.743896 16666 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:03:43.743916 16666 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:03:43.748553 16666 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:39467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:36941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:36941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:43.749620 16666 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:43.750465 16666 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:43.756347 16672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:43.756369 16671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:43.756498 16674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:43.756600 16666 server_base.cc:1047] running on GCE node
I20251211 15:03:43.757095 16666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:43.758101 16666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:43.759254 16666 hybrid_clock.cc:648] HybridClock initialized: now 1765465423759234 us; error 41 us; skew 500 ppm
Dec 11 15:03:43 dist-test-slave-4k3m krb5kdc[16650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465423, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:43.761993 16666 init.cc:377] Logged in from keytab as kudu/127.5.160.190@KRBTEST.COM (short username kudu)
I20251211 15:03:43.763294 16666 webserver.cc:492] Webserver started at http://127.5.160.190:38053/ using document root <none> and password file <none>
I20251211 15:03:43.763857 16666 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:43.763909 16666 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:43.764102 16666 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:43.765858 16666 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "5b925f0f71fa4e77b514f7b9775ecb31"
format_stamp: "Formatted at 2025-12-11 15:03:43 on dist-test-slave-4k3m"
server_key: "ec55c473e3f81b1ee0f1e5eda45ea8d6"
server_key_iv: "05698fc956690f0d22e0da80f7b80067"
server_key_version: "encryptionkey@0"
I20251211 15:03:43.766366 16666 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "5b925f0f71fa4e77b514f7b9775ecb31"
format_stamp: "Formatted at 2025-12-11 15:03:43 on dist-test-slave-4k3m"
server_key: "ec55c473e3f81b1ee0f1e5eda45ea8d6"
server_key_iv: "05698fc956690f0d22e0da80f7b80067"
server_key_version: "encryptionkey@0"
I20251211 15:03:43.769897 16666 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20251211 15:03:43.772534 16681 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:43.773680 16666 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20251211 15:03:43.773834 16666 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "5b925f0f71fa4e77b514f7b9775ecb31"
format_stamp: "Formatted at 2025-12-11 15:03:43 on dist-test-slave-4k3m"
server_key: "ec55c473e3f81b1ee0f1e5eda45ea8d6"
server_key_iv: "05698fc956690f0d22e0da80f7b80067"
server_key_version: "encryptionkey@0"
I20251211 15:03:43.773938 16666 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:43.788236 16666 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:43.791605 16666 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:43.791806 16666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:43.799273 16666 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:36941
I20251211 15:03:43.799304 16733 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:36941 every 8 connection(s)
I20251211 15:03:43.800318 16666 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:03:43.803274 16734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:43.809011 16734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31: Bootstrap starting.
I20251211 15:03:43.809369  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 16666
I20251211 15:03:43.809509  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:03:43.809778  5762 external_mini_cluster.cc:1468] Setting key c67fee59c9d23134cadbcfc78e7482fc
I20251211 15:03:43.811723 16734 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:43.812438 16734 log.cc:826] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:43.814481 16734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31: No bootstrap required, opened a new log
Dec 11 15:03:43 dist-test-slave-4k3m krb5kdc[16650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:03:43.817593 16734 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b925f0f71fa4e77b514f7b9775ecb31" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 36941 } }
I20251211 15:03:43.817823 16734 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:43.817929 16734 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b925f0f71fa4e77b514f7b9775ecb31, State: Initialized, Role: FOLLOWER
I20251211 15:03:43.818399 16734 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b925f0f71fa4e77b514f7b9775ecb31" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 36941 } }
I20251211 15:03:43.818569 16734 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:03:43.818638 16734 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:03:43.818728 16734 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:43.819604 16734 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b925f0f71fa4e77b514f7b9775ecb31" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 36941 } }
I20251211 15:03:43.819947 16734 leader_election.cc:304] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b925f0f71fa4e77b514f7b9775ecb31; no voters: 
I20251211 15:03:43.820281 16734 leader_election.cc:290] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:03:43.820362 16739 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:43.820542 16739 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [term 1 LEADER]: Becoming Leader. State: Replica: 5b925f0f71fa4e77b514f7b9775ecb31, State: Running, Role: LEADER
I20251211 15:03:43.821163 16739 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b925f0f71fa4e77b514f7b9775ecb31" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 36941 } }
I20251211 15:03:43.821465 16734 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:03:43.822285 16739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b925f0f71fa4e77b514f7b9775ecb31. Latest consensus state: current_term: 1 leader_uuid: "5b925f0f71fa4e77b514f7b9775ecb31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b925f0f71fa4e77b514f7b9775ecb31" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 36941 } } }
I20251211 15:03:43.822477 16739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:43.822583 16740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b925f0f71fa4e77b514f7b9775ecb31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b925f0f71fa4e77b514f7b9775ecb31" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 36941 } } }
I20251211 15:03:43.822741 16740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31 [sys.catalog]: This master's current role is: LEADER
I20251211 15:03:43.822775 16737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:43.811059 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49472 (local address 127.5.160.190:36941)
1211 15:03:43.811477 (+   418us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:43.811487 (+    10us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:43.811557 (+    70us) server_negotiation.cc:408] Connection header received
1211 15:03:43.812141 (+   584us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:43.812163 (+    22us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:43.812467 (+   304us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:43.812885 (+   418us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:43.813701 (+   816us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:43.814429 (+   728us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:43.815321 (+   892us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:43.815604 (+   283us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:43.817951 (+  2347us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:43.817970 (+    19us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:43.817982 (+    12us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:43.818023 (+    41us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:43.819754 (+  1731us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:43.820211 (+   457us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:43.820216 (+     5us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:43.820220 (+     4us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:43.820313 (+    93us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:43.820591 (+   278us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:43.820594 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:43.820596 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:43.820979 (+   383us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:43.821171 (+   192us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:43.821819 (+   648us) server_negotiation.cc:300] Negotiation successful
1211 15:03:43.822028 (+   209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":141,"threads_started":1}
I20251211 15:03:43.822876 16748 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:03:43.826315 16748 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:03:43.831586 16748 catalog_manager.cc:1357] Generated new cluster ID: 06121f2f8747481c92e28bdb3da1ca8b
I20251211 15:03:43.831668 16748 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:03:43.842216 16748 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:03:43.843443 16748 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:03:43.851748 16748 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31: Generated new TSK 0
I20251211 15:03:43.852644 16748 catalog_manager.cc:1524] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:03:43.903759  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:36941
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:39467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:44.032115 16762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:44.032354 16762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:44.032413 16762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:44.035749 16762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:44.035822 16762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:44.035904 16762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:03:44.040277 16762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:39467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:36941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16762
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:44.041354 16762 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:44.042202 16762 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:44.048916 16770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:44.048918 16767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:44.048931 16768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:44.049226 16762 server_base.cc:1047] running on GCE node
I20251211 15:03:44.049571 16762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:44.050134 16762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:44.051275 16762 hybrid_clock.cc:648] HybridClock initialized: now 1765465424051264 us; error 36 us; skew 500 ppm
Dec 11 15:03:44 dist-test-slave-4k3m krb5kdc[16650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465424, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:44.053817 16762 init.cc:377] Logged in from keytab as kudu/127.5.160.129@KRBTEST.COM (short username kudu)
I20251211 15:03:44.054876 16762 webserver.cc:492] Webserver started at http://127.5.160.129:41851/ using document root <none> and password file <none>
I20251211 15:03:44.055431 16762 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:44.055480 16762 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:44.055656 16762 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:44.057349 16762 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "2a625dab5fb348518201e3b6a2efd434"
format_stamp: "Formatted at 2025-12-11 15:03:44 on dist-test-slave-4k3m"
server_key: "bcdcec1324ea3d507e115f8e49e64dec"
server_key_iv: "ef73fd6b9c1425635eddd60f590fb24c"
server_key_version: "encryptionkey@0"
I20251211 15:03:44.057816 16762 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "2a625dab5fb348518201e3b6a2efd434"
format_stamp: "Formatted at 2025-12-11 15:03:44 on dist-test-slave-4k3m"
server_key: "bcdcec1324ea3d507e115f8e49e64dec"
server_key_iv: "ef73fd6b9c1425635eddd60f590fb24c"
server_key_version: "encryptionkey@0"
I20251211 15:03:44.061169 16762 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20251211 15:03:44.063486 16777 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:44.064534 16762 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:44.064630 16762 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "2a625dab5fb348518201e3b6a2efd434"
format_stamp: "Formatted at 2025-12-11 15:03:44 on dist-test-slave-4k3m"
server_key: "bcdcec1324ea3d507e115f8e49e64dec"
server_key_iv: "ef73fd6b9c1425635eddd60f590fb24c"
server_key_version: "encryptionkey@0"
I20251211 15:03:44.064724 16762 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:44.082024 16762 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:44.085191 16762 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:44.085371 16762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:44.085948 16762 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:44.086839 16762 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:44.086887 16762 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:44.086956 16762 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:44.086987 16762 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:44.095921 16762 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:45169
I20251211 15:03:44.095959 16890 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:45169 every 8 connection(s)
I20251211 15:03:44.096864 16762 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:03:44.100067  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 16762
I20251211 15:03:44.100188  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:03:44.100414  5762 external_mini_cluster.cc:1468] Setting key 96f6c6390ec0177a543b75a463cc67c6
Dec 11 15:03:44 dist-test-slave-4k3m krb5kdc[16650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465424, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.160.130@KRBTEST.COM; defaulting to no policy
I20251211 15:03:44.109923 16737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.098641 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:43877 (local address 127.5.160.190:36941)
1211 15:03:44.098794 (+   153us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:44.098798 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:44.099469 (+   671us) server_negotiation.cc:408] Connection header received
1211 15:03:44.100320 (+   851us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:44.100324 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:44.100381 (+    57us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:44.100457 (+    76us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:44.102412 (+  1955us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.102920 (+   508us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.103621 (+   701us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.103775 (+   154us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.105926 (+  2151us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:44.105953 (+    27us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:44.105957 (+     4us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:44.105992 (+    35us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:44.107702 (+  1710us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:44.108204 (+   502us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:44.108208 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:44.108210 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:44.108275 (+    65us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:44.108598 (+   323us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:44.108602 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:44.108689 (+    87us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:44.108888 (+   199us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:44.109007 (+   119us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:44.109608 (+   601us) server_negotiation.cc:300] Negotiation successful
1211 15:03:44.109758 (+   150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20251211 15:03:44.110599 16893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.098887 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:36941 (local address 127.5.160.129:43877)
1211 15:03:44.099331 (+   444us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:44.099367 (+    36us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:44.100114 (+   747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:44.100628 (+   514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:44.100637 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:44.101137 (+   500us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:44.102268 (+  1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.102283 (+    15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.103083 (+   800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.103088 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:44.103505 (+   417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.103513 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.103698 (+   185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.104285 (+   587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:44.104308 (+    23us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:44.105759 (+  1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:44.107832 (+  2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:44.107838 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:44.107849 (+    11us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:44.108096 (+   247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:44.108363 (+   267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:44.108366 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:44.108367 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:44.108479 (+   112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:44.109033 (+   554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:44.109041 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:44.109293 (+   252us) client_negotiation.cc:769] Sending connection context
1211 15:03:44.109526 (+   233us) client_negotiation.cc:240] Negotiation successful
1211 15:03:44.109824 (+   298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":90,"threads_started":1}
I20251211 15:03:44.111951 16891 heartbeater.cc:344] Connected to a master server at 127.5.160.190:36941
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.130@KRBTEST.COM" created.
I20251211 15:03:44.112255 16891 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:44.112911 16891 heartbeater.cc:507] Master 127.5.160.190:36941 requested a full tablet report, sending...
I20251211 15:03:44.114562 16698 ts_manager.cc:194] Registered new tserver with Master: 2a625dab5fb348518201e3b6a2efd434 (127.5.160.129:45169)
I20251211 15:03:44.115867 16698 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:43877
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:03:44.149720  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:36941
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:39467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:44.258705 16898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:44.258991 16898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:44.259080 16898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:44.262470 16898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:44.262547 16898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:44.262627 16898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:03:44.266976 16898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:39467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:36941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:44.268005 16898 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:44.268841 16898 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:44.275734 16906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:44.275908 16904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:44.275791 16898 server_base.cc:1047] running on GCE node
W20251211 15:03:44.275956 16903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:44.276274 16898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:44.276810 16898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:44.277981 16898 hybrid_clock.cc:648] HybridClock initialized: now 1765465424277967 us; error 27 us; skew 500 ppm
Dec 11 15:03:44 dist-test-slave-4k3m krb5kdc[16650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465424, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:44.280699 16898 init.cc:377] Logged in from keytab as kudu/127.5.160.130@KRBTEST.COM (short username kudu)
I20251211 15:03:44.281796 16898 webserver.cc:492] Webserver started at http://127.5.160.130:34349/ using document root <none> and password file <none>
I20251211 15:03:44.282308 16898 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:44.282354 16898 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:44.282512 16898 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:44.284235 16898 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "acf2f39f448743fc8fb86c742dee95f6"
format_stamp: "Formatted at 2025-12-11 15:03:44 on dist-test-slave-4k3m"
server_key: "1428fcfaf884bcdf2baf66fa231b2340"
server_key_iv: "7299eed02a5d8ef1f34942b72a42efb9"
server_key_version: "encryptionkey@0"
I20251211 15:03:44.284659 16898 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "acf2f39f448743fc8fb86c742dee95f6"
format_stamp: "Formatted at 2025-12-11 15:03:44 on dist-test-slave-4k3m"
server_key: "1428fcfaf884bcdf2baf66fa231b2340"
server_key_iv: "7299eed02a5d8ef1f34942b72a42efb9"
server_key_version: "encryptionkey@0"
I20251211 15:03:44.288080 16898 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20251211 15:03:44.290279 16913 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:44.291435 16898 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20251211 15:03:44.291545 16898 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "acf2f39f448743fc8fb86c742dee95f6"
format_stamp: "Formatted at 2025-12-11 15:03:44 on dist-test-slave-4k3m"
server_key: "1428fcfaf884bcdf2baf66fa231b2340"
server_key_iv: "7299eed02a5d8ef1f34942b72a42efb9"
server_key_version: "encryptionkey@0"
I20251211 15:03:44.291652 16898 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:44.313212 16898 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:44.316241 16898 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:44.316432 16898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:44.316999 16898 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:44.317929 16898 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:44.317977 16898 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:44.318032 16898 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:44.318059 16898 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:44.327634 16898 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:36109
I20251211 15:03:44.327647 17026 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:36109 every 8 connection(s)
I20251211 15:03:44.328598 16898 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:03:44.335541  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 16898
I20251211 15:03:44.335659  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:03:44.335906  5762 external_mini_cluster.cc:1468] Setting key 3e02d6d0d2ae96f501854cd00931096a
Dec 11 15:03:44 dist-test-slave-4k3m krb5kdc[16650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465424, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:03:44.340960 16737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.330285 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:36527 (local address 127.5.160.190:36941)
1211 15:03:44.330437 (+   152us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:44.330441 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:44.331177 (+   736us) server_negotiation.cc:408] Connection header received
1211 15:03:44.332079 (+   902us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:44.332083 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:44.332144 (+    61us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:44.332217 (+    73us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:44.333935 (+  1718us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.334436 (+   501us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.335102 (+   666us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.335279 (+   177us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.337709 (+  2430us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:44.337726 (+    17us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:44.337728 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:44.337755 (+    27us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:44.339117 (+  1362us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:44.339577 (+   460us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:44.339580 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:44.339582 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:44.339629 (+    47us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:44.339912 (+   283us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:44.339916 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:44.339918 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:44.340075 (+   157us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:44.340159 (+    84us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:44.340664 (+   505us) server_negotiation.cc:300] Negotiation successful
1211 15:03:44.340796 (+   132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20251211 15:03:44.341619 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.330567 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:36941 (local address 127.5.160.130:36527)
1211 15:03:44.331047 (+   480us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:44.331085 (+    38us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:44.331878 (+   793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:44.332394 (+   516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:44.332403 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:44.332824 (+   421us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:44.333767 (+   943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.333781 (+    14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.334559 (+   778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.334562 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:44.334988 (+   426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.334997 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.335209 (+   212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.335820 (+   611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:44.335845 (+    25us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:44.337562 (+  1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:44.339229 (+  1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:44.339236 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:44.339249 (+    13us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:44.339476 (+   227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:44.339710 (+   234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:44.339713 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:44.339714 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:44.339826 (+   112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:44.340174 (+   348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:44.340181 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:44.340420 (+   239us) client_negotiation.cc:769] Sending connection context
1211 15:03:44.340619 (+   199us) client_negotiation.cc:240] Negotiation successful
1211 15:03:44.340911 (+   292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":97,"threads_started":1}
I20251211 15:03:44.342900 17027 heartbeater.cc:344] Connected to a master server at 127.5.160.190:36941
I20251211 15:03:44.343181 17027 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:44.343730 17027 heartbeater.cc:507] Master 127.5.160.190:36941 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.5.160.131@KRBTEST.COM; defaulting to no policy
I20251211 15:03:44.344822 16698 ts_manager.cc:194] Registered new tserver with Master: acf2f39f448743fc8fb86c742dee95f6 (127.5.160.130:36109)
I20251211 15:03:44.345378 16698 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.130@KRBTEST.COM'} at 127.5.160.130:36527
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:03:44.382119  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.131:0
--local_ip_for_outbound_sockets=127.5.160.131
--webserver_interface=127.5.160.131
--webserver_port=0
--tserver_master_addrs=127.5.160.190:36941
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:39467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:03:44.489477 17034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:03:44.489722 17034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:03:44.489781 17034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:03:44.493103 17034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:03:44.493173 17034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:03:44.493253 17034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.131
I20251211 15:03:44.497550 17034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:39467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.160.131
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:36941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.131
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:03:44.498612 17034 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:03:44.499480 17034 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:03:44.506016 17042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:03:44.506028 17039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:44.506148 17034 server_base.cc:1047] running on GCE node
W20251211 15:03:44.506013 17040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:03:44.506808 17034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:03:44.507364 17034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:03:44.508531 17034 hybrid_clock.cc:648] HybridClock initialized: now 1765465424508506 us; error 40 us; skew 500 ppm
Dec 11 15:03:44 dist-test-slave-4k3m krb5kdc[16650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465424, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:03:44.511265 17034 init.cc:377] Logged in from keytab as kudu/127.5.160.131@KRBTEST.COM (short username kudu)
I20251211 15:03:44.512329 17034 webserver.cc:492] Webserver started at http://127.5.160.131:39363/ using document root <none> and password file <none>
I20251211 15:03:44.512869 17034 fs_manager.cc:362] Metadata directory not provided
I20251211 15:03:44.512918 17034 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:03:44.513089 17034 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 15:03:44.514755 17034 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data/instance:
uuid: "20f83f29bcbb4a84bea17aef6d0ab676"
format_stamp: "Formatted at 2025-12-11 15:03:44 on dist-test-slave-4k3m"
server_key: "b569b98cc2bf0cff8bc9976e0450fba3"
server_key_iv: "185d04ab4f287bf2d579aad3bc87b66a"
server_key_version: "encryptionkey@0"
I20251211 15:03:44.515232 17034 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance:
uuid: "20f83f29bcbb4a84bea17aef6d0ab676"
format_stamp: "Formatted at 2025-12-11 15:03:44 on dist-test-slave-4k3m"
server_key: "b569b98cc2bf0cff8bc9976e0450fba3"
server_key_iv: "185d04ab4f287bf2d579aad3bc87b66a"
server_key_version: "encryptionkey@0"
I20251211 15:03:44.518523 17034 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20251211 15:03:44.520768 17049 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:44.521867 17034 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20251211 15:03:44.521979 17034 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal
uuid: "20f83f29bcbb4a84bea17aef6d0ab676"
format_stamp: "Formatted at 2025-12-11 15:03:44 on dist-test-slave-4k3m"
server_key: "b569b98cc2bf0cff8bc9976e0450fba3"
server_key_iv: "185d04ab4f287bf2d579aad3bc87b66a"
server_key_version: "encryptionkey@0"
I20251211 15:03:44.522073 17034 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:03:44.546141 17034 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:03:44.549129 17034 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:03:44.549319 17034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:03:44.549883 17034 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:03:44.550781 17034 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:03:44.550829 17034 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:44.550881 17034 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:03:44.550909 17034 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:03:44.559767 17034 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.131:43561
I20251211 15:03:44.559808 17162 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.131:43561 every 8 connection(s)
I20251211 15:03:44.560714 17034 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/data/info.pb
I20251211 15:03:44.568109  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 17034
I20251211 15:03:44.568259  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-2/wal/instance
I20251211 15:03:44.568507  5762 external_mini_cluster.cc:1468] Setting key 9f4393a6e89526d5a1e3bd442e7ad189
Dec 11 15:03:44 dist-test-slave-4k3m krb5kdc[16650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465424, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.131@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:03:44.573750 16737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.562481 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.131:49489 (local address 127.5.160.190:36941)
1211 15:03:44.562644 (+   163us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:44.562648 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:44.563373 (+   725us) server_negotiation.cc:408] Connection header received
1211 15:03:44.564253 (+   880us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:44.564257 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:44.564310 (+    53us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:44.564398 (+    88us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:44.566150 (+  1752us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.566783 (+   633us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.567517 (+   734us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.567669 (+   152us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.570311 (+  2642us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:44.570327 (+    16us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:44.570329 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:44.570356 (+    27us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:44.571846 (+  1490us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:44.572318 (+   472us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:44.572322 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:44.572324 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:44.572370 (+    46us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:44.572679 (+   309us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:44.572682 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:44.572684 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:44.572866 (+   182us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:44.572952 (+    86us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:44.573454 (+   502us) server_negotiation.cc:300] Negotiation successful
1211 15:03:44.573585 (+   131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20251211 15:03:44.574388 17165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.562739 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:36941 (local address 127.5.160.131:49489)
1211 15:03:44.563227 (+   488us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:44.563270 (+    43us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:44.564055 (+   785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:44.564545 (+   490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:44.564554 (+     9us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:44.564972 (+   418us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:03:44.565978 (+  1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.565996 (+    18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.566976 (+   980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.566981 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:44.567392 (+   411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.567402 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.567612 (+   210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.568347 (+   735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:03:44.568378 (+    31us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:03:44.570148 (+  1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:03:44.571963 (+  1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:44.571969 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:44.571983 (+    14us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:44.572224 (+   241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:44.572450 (+   226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:03:44.572453 (+     3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:03:44.572454 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:03:44.572591 (+   137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:03:44.572968 (+   377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:03:44.572975 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:03:44.573218 (+   243us) client_negotiation.cc:769] Sending connection context
1211 15:03:44.573409 (+   191us) client_negotiation.cc:240] Negotiation successful
1211 15:03:44.573700 (+   291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":129,"threads_started":1}
I20251211 15:03:44.575460 17163 heartbeater.cc:344] Connected to a master server at 127.5.160.190:36941
I20251211 15:03:44.575695 17163 heartbeater.cc:461] Registering TS with master...
I20251211 15:03:44.576201 17163 heartbeater.cc:507] Master 127.5.160.190:36941 requested a full tablet report, sending...
I20251211 15:03:44.577216 16698 ts_manager.cc:194] Registered new tserver with Master: 20f83f29bcbb4a84bea17aef6d0ab676 (127.5.160.131:43561)
I20251211 15:03:44.577754 16698 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.131@KRBTEST.COM'} at 127.5.160.131:49489
I20251211 15:03:44.582327  5762 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251211 15:03:44.590261 16737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.584189 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49480 (local address 127.5.160.190:36941)
1211 15:03:44.584323 (+   134us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:44.584326 (+     3us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:44.584418 (+    92us) server_negotiation.cc:408] Connection header received
1211 15:03:44.584595 (+   177us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:44.584598 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:44.584645 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:44.584748 (+   103us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:03:44.585523 (+   775us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.586048 (+   525us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.586609 (+   561us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.586758 (+   149us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.587768 (+  1010us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:03:44.587783 (+    15us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:03:44.587785 (+     2us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:03:44.587807 (+    22us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:03:44.589031 (+  1224us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:44.589396 (+   365us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:44.589399 (+     3us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:44.589401 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:44.589447 (+    46us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:03:44.589614 (+   167us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:03:44.589616 (+     2us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:03:44.589617 (+     1us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:03:44.589781 (+   164us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:03:44.589877 (+    96us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:44.590021 (+   144us) server_negotiation.cc:300] Negotiation successful
1211 15:03:44.590114 (+    93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20251211 15:03:44.592876 16698 catalog_manager.cc:2257] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49480:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20251211 15:03:44.595230 16698 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 15:03:44.608167 17174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.603625 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:43561 (local address 127.0.0.1:56098)
1211 15:03:44.604412 (+   787us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:44.604451 (+    39us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:44.604653 (+   202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:44.605221 (+   568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:44.605227 (+     6us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:44.605252 (+    25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:44.605563 (+   311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.605572 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.606846 (+  1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.606850 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:44.607704 (+   854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.607713 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.607811 (+    98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.607856 (+    45us) client_negotiation.cc:769] Sending connection context
1211 15:03:44.607924 (+    68us) client_negotiation.cc:240] Negotiation successful
1211 15:03:44.608015 (+    91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"spinlock_wait_cycles":16512,"thread_start_us":92,"threads_started":1}
I20251211 15:03:44.608342 17177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.604335 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.130:36109 (local address 127.0.0.1:50084)
1211 15:03:44.604721 (+   386us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:44.604732 (+    11us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:44.604822 (+    90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:44.605528 (+   706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:44.605531 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:44.605559 (+    28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:44.605854 (+   295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.605862 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.607130 (+  1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.607134 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:44.607959 (+   825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.607967 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.608029 (+    62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.608041 (+    12us) client_negotiation.cc:769] Sending connection context
1211 15:03:44.608076 (+    35us) client_negotiation.cc:240] Negotiation successful
1211 15:03:44.608114 (+    38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"spinlock_wait_cycles":8448,"thread_start_us":85,"threads_started":1}
I20251211 15:03:44.608342 17176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.603823 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:45169 (local address 127.0.0.1:40776)
1211 15:03:44.604433 (+   610us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:44.604461 (+    28us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:44.604920 (+   459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:44.605559 (+   639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:44.605562 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:44.605583 (+    21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:44.605854 (+   271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.605862 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.606958 (+  1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.606962 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:44.607862 (+   900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.607872 (+    10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.607980 (+   108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.608000 (+    20us) client_negotiation.cc:769] Sending connection context
1211 15:03:44.608046 (+    46us) client_negotiation.cc:240] Negotiation successful
1211 15:03:44.608104 (+    58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"spinlock_wait_cycles":91008,"thread_start_us":101,"threads_started":1}
I20251211 15:03:44.609141 17178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.604482 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40776 (local address 127.5.160.129:45169)
1211 15:03:44.605187 (+   705us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:44.605194 (+     7us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:44.605214 (+    20us) server_negotiation.cc:408] Connection header received
1211 15:03:44.605290 (+    76us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:44.605295 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:44.605431 (+   136us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:44.605989 (+   558us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:44.606105 (+   116us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.606769 (+   664us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.608014 (+  1245us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.608756 (+   742us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.608903 (+   147us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:44.608957 (+    54us) server_negotiation.cc:300] Negotiation successful
1211 15:03:44.609034 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":81,"threads_started":1}
I20251211 15:03:44.609573 17175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.603742 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56098 (local address 127.5.160.131:43561)
1211 15:03:44.604163 (+   421us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:44.604170 (+     7us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:44.604780 (+   610us) server_negotiation.cc:408] Connection header received
1211 15:03:44.604870 (+    90us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:44.604875 (+     5us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:44.605059 (+   184us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:44.605203 (+   144us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:44.605676 (+   473us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.606726 (+  1050us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.608383 (+  1657us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.609244 (+   861us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.609319 (+    75us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:44.609371 (+    52us) server_negotiation.cc:300] Negotiation successful
1211 15:03:44.609440 (+    69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":128,"threads_started":1}
I20251211 15:03:44.609582 17179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.604787 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50084 (local address 127.5.160.130:36109)
1211 15:03:44.605143 (+   356us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:44.605149 (+     6us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:44.605169 (+    20us) server_negotiation.cc:408] Connection header received
1211 15:03:44.605242 (+    73us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:44.605246 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:44.605393 (+   147us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:44.605518 (+   125us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:44.605968 (+   450us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.607016 (+  1048us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.608455 (+  1439us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.609194 (+   739us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.609289 (+    95us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:44.609354 (+    65us) server_negotiation.cc:300] Negotiation successful
1211 15:03:44.609439 (+    85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":104,"threads_started":1}
I20251211 15:03:44.611989 17097 tablet_service.cc:1505] Processing CreateTablet for tablet 9880139c59dc41a6b015f1db0ddf6c5c (DEFAULT_TABLE table=test-table [id=918c3b27ee0f4eb9961edd2e0073cb62]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:44.611994 16961 tablet_service.cc:1505] Processing CreateTablet for tablet 9880139c59dc41a6b015f1db0ddf6c5c (DEFAULT_TABLE table=test-table [id=918c3b27ee0f4eb9961edd2e0073cb62]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:44.611992 16825 tablet_service.cc:1505] Processing CreateTablet for tablet 9880139c59dc41a6b015f1db0ddf6c5c (DEFAULT_TABLE table=test-table [id=918c3b27ee0f4eb9961edd2e0073cb62]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 15:03:44.612901 17097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9880139c59dc41a6b015f1db0ddf6c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:44.612905 16825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9880139c59dc41a6b015f1db0ddf6c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:44.612903 16961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9880139c59dc41a6b015f1db0ddf6c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:03:44.618415 17180 tablet_bootstrap.cc:492] T 9880139c59dc41a6b015f1db0ddf6c5c P 20f83f29bcbb4a84bea17aef6d0ab676: Bootstrap starting.
I20251211 15:03:44.619853 17182 tablet_bootstrap.cc:492] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434: Bootstrap starting.
I20251211 15:03:44.620968 17180 tablet_bootstrap.cc:654] T 9880139c59dc41a6b015f1db0ddf6c5c P 20f83f29bcbb4a84bea17aef6d0ab676: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:44.621827 17182 tablet_bootstrap.cc:654] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:44.621836 17180 log.cc:826] T 9880139c59dc41a6b015f1db0ddf6c5c P 20f83f29bcbb4a84bea17aef6d0ab676: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:44.622530 17181 tablet_bootstrap.cc:492] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6: Bootstrap starting.
I20251211 15:03:44.622642 17182 log.cc:826] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:44.623739 17180 tablet_bootstrap.cc:492] T 9880139c59dc41a6b015f1db0ddf6c5c P 20f83f29bcbb4a84bea17aef6d0ab676: No bootstrap required, opened a new log
I20251211 15:03:44.623921 17180 ts_tablet_manager.cc:1403] T 9880139c59dc41a6b015f1db0ddf6c5c P 20f83f29bcbb4a84bea17aef6d0ab676: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20251211 15:03:44.624490 17182 tablet_bootstrap.cc:492] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434: No bootstrap required, opened a new log
I20251211 15:03:44.624603 17181 tablet_bootstrap.cc:654] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6: Neither blocks nor log segments found. Creating new log.
I20251211 15:03:44.624763 17182 ts_tablet_manager.cc:1403] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434: Time spent bootstrapping tablet: real 0.005s	user 0.005s	sys 0.000s
I20251211 15:03:44.625437 17181 log.cc:826] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6: Log is configured to *not* fsync() on all Append() calls
I20251211 15:03:44.627166 17180 raft_consensus.cc:359] T 9880139c59dc41a6b015f1db0ddf6c5c P 20f83f29bcbb4a84bea17aef6d0ab676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f83f29bcbb4a84bea17aef6d0ab676" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43561 } } peers { permanent_uuid: "2a625dab5fb348518201e3b6a2efd434" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 45169 } } peers { permanent_uuid: "acf2f39f448743fc8fb86c742dee95f6" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 36109 } }
I20251211 15:03:44.627349 17180 raft_consensus.cc:385] T 9880139c59dc41a6b015f1db0ddf6c5c P 20f83f29bcbb4a84bea17aef6d0ab676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:44.627355 17181 tablet_bootstrap.cc:492] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6: No bootstrap required, opened a new log
I20251211 15:03:44.627422 17180 raft_consensus.cc:740] T 9880139c59dc41a6b015f1db0ddf6c5c P 20f83f29bcbb4a84bea17aef6d0ab676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20f83f29bcbb4a84bea17aef6d0ab676, State: Initialized, Role: FOLLOWER
I20251211 15:03:44.627528 17181 ts_tablet_manager.cc:1403] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20251211 15:03:44.627846 17180 consensus_queue.cc:260] T 9880139c59dc41a6b015f1db0ddf6c5c P 20f83f29bcbb4a84bea17aef6d0ab676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f83f29bcbb4a84bea17aef6d0ab676" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43561 } } peers { permanent_uuid: "2a625dab5fb348518201e3b6a2efd434" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 45169 } } peers { permanent_uuid: "acf2f39f448743fc8fb86c742dee95f6" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 36109 } }
I20251211 15:03:44.627763 17182 raft_consensus.cc:359] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f83f29bcbb4a84bea17aef6d0ab676" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43561 } } peers { permanent_uuid: "2a625dab5fb348518201e3b6a2efd434" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 45169 } } peers { permanent_uuid: "acf2f39f448743fc8fb86c742dee95f6" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 36109 } }
I20251211 15:03:44.627961 17182 raft_consensus.cc:385] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:44.628054 17182 raft_consensus.cc:740] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a625dab5fb348518201e3b6a2efd434, State: Initialized, Role: FOLLOWER
I20251211 15:03:44.628461 17163 heartbeater.cc:499] Master 127.5.160.190:36941 was elected leader, sending a full tablet report...
I20251211 15:03:44.628554 17182 consensus_queue.cc:260] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f83f29bcbb4a84bea17aef6d0ab676" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43561 } } peers { permanent_uuid: "2a625dab5fb348518201e3b6a2efd434" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 45169 } } peers { permanent_uuid: "acf2f39f448743fc8fb86c742dee95f6" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 36109 } }
I20251211 15:03:44.628684 17180 ts_tablet_manager.cc:1434] T 9880139c59dc41a6b015f1db0ddf6c5c P 20f83f29bcbb4a84bea17aef6d0ab676: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20251211 15:03:44.629343 17182 ts_tablet_manager.cc:1434] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20251211 15:03:44.629776 16891 heartbeater.cc:499] Master 127.5.160.190:36941 was elected leader, sending a full tablet report...
I20251211 15:03:44.632180 17181 raft_consensus.cc:359] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f83f29bcbb4a84bea17aef6d0ab676" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43561 } } peers { permanent_uuid: "2a625dab5fb348518201e3b6a2efd434" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 45169 } } peers { permanent_uuid: "acf2f39f448743fc8fb86c742dee95f6" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 36109 } }
I20251211 15:03:44.632423 17181 raft_consensus.cc:385] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:03:44.632516 17181 raft_consensus.cc:740] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acf2f39f448743fc8fb86c742dee95f6, State: Initialized, Role: FOLLOWER
I20251211 15:03:44.632993 17181 consensus_queue.cc:260] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f83f29bcbb4a84bea17aef6d0ab676" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43561 } } peers { permanent_uuid: "2a625dab5fb348518201e3b6a2efd434" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 45169 } } peers { permanent_uuid: "acf2f39f448743fc8fb86c742dee95f6" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 36109 } }
I20251211 15:03:44.633622 17027 heartbeater.cc:499] Master 127.5.160.190:36941 was elected leader, sending a full tablet report...
I20251211 15:03:44.633857 17181 ts_tablet_manager.cc:1434] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20251211 15:03:44.730320 17188 raft_consensus.cc:493] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 15:03:44.730501 17188 raft_consensus.cc:515] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f83f29bcbb4a84bea17aef6d0ab676" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43561 } } peers { permanent_uuid: "2a625dab5fb348518201e3b6a2efd434" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 45169 } } peers { permanent_uuid: "acf2f39f448743fc8fb86c742dee95f6" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 36109 } }
I20251211 15:03:44.731638 17188 leader_election.cc:290] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20f83f29bcbb4a84bea17aef6d0ab676 (127.5.160.131:43561), 2a625dab5fb348518201e3b6a2efd434 (127.5.160.129:45169)
I20251211 15:03:44.734386 17029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.731890 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.131:43561 (local address 127.5.160.130:47319)
1211 15:03:44.732026 (+   136us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:44.732043 (+    17us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:44.732137 (+    94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:44.732395 (+   258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:44.732398 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:44.732421 (+    23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:44.732649 (+   228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.732656 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.733398 (+   742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.733401 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:44.733979 (+   578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.733986 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.734096 (+   110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.734126 (+    30us) client_negotiation.cc:769] Sending connection context
1211 15:03:44.734177 (+    51us) client_negotiation.cc:240] Negotiation successful
1211 15:03:44.734243 (+    66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"spinlock_wait_cycles":26880}
I20251211 15:03:44.734814 17175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.731999 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:47319 (local address 127.5.160.131:43561)
1211 15:03:44.732154 (+   155us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:44.732158 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:44.732175 (+    17us) server_negotiation.cc:408] Connection header received
1211 15:03:44.732226 (+    51us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:44.732228 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:44.732270 (+    42us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:44.732351 (+    81us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:44.732781 (+   430us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.733279 (+   498us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.734106 (+   827us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.734559 (+   453us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.734603 (+    44us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:44.734656 (+    53us) server_negotiation.cc:300] Negotiation successful
1211 15:03:44.734715 (+    59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20251211 15:03:44.735395 17117 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9880139c59dc41a6b015f1db0ddf6c5c" candidate_uuid: "acf2f39f448743fc8fb86c742dee95f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f83f29bcbb4a84bea17aef6d0ab676" is_pre_election: true
I20251211 15:03:44.735445 17178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.732029 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.130:47979 (local address 127.5.160.129:45169)
1211 15:03:44.732146 (+   117us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:44.732151 (+     5us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:44.732445 (+   294us) server_negotiation.cc:408] Connection header received
1211 15:03:44.732580 (+   135us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:44.732583 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:44.732626 (+    43us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:44.732688 (+    62us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
1211 15:03:44.733138 (+   450us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.733713 (+   575us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.734610 (+   897us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.735065 (+   455us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.735099 (+    34us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:44.735279 (+   180us) server_negotiation.cc:300] Negotiation successful
1211 15:03:44.735345 (+    66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20251211 15:03:44.735446 17189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.731890 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:45169 (local address 127.5.160.130:47979)
1211 15:03:44.732347 (+   457us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:44.732358 (+    11us) client_negotiation.cc:174] Beginning negotiation
1211 15:03:44.732480 (+   122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:03:44.732709 (+   229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:03:44.732712 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:03:44.732728 (+    16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
1211 15:03:44.732979 (+   251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.732985 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.733848 (+   863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.733852 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:03:44.734460 (+   608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:03:44.734469 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.735153 (+   684us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.735166 (+    13us) client_negotiation.cc:769] Sending connection context
1211 15:03:44.735235 (+    69us) client_negotiation.cc:240] Negotiation successful
1211 15:03:44.735296 (+    61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"mutex_wait_us":132,"spinlock_wait_cycles":1920,"thread_start_us":131,"threads_started":1}
I20251211 15:03:44.735694 17117 raft_consensus.cc:2468] T 9880139c59dc41a6b015f1db0ddf6c5c P 20f83f29bcbb4a84bea17aef6d0ab676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acf2f39f448743fc8fb86c742dee95f6 in term 0.
I20251211 15:03:44.736074 16845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9880139c59dc41a6b015f1db0ddf6c5c" candidate_uuid: "acf2f39f448743fc8fb86c742dee95f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a625dab5fb348518201e3b6a2efd434" is_pre_election: true
I20251211 15:03:44.736205 16916 leader_election.cc:304] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20f83f29bcbb4a84bea17aef6d0ab676, acf2f39f448743fc8fb86c742dee95f6; no voters: 
I20251211 15:03:44.736337 16845 raft_consensus.cc:2468] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acf2f39f448743fc8fb86c742dee95f6 in term 0.
I20251211 15:03:44.736497 17188 raft_consensus.cc:2804] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 15:03:44.736594 17188 raft_consensus.cc:493] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 15:03:44.736652 17188 raft_consensus.cc:3060] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:44.737788 17188 raft_consensus.cc:515] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f83f29bcbb4a84bea17aef6d0ab676" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43561 } } peers { permanent_uuid: "2a625dab5fb348518201e3b6a2efd434" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 45169 } } peers { permanent_uuid: "acf2f39f448743fc8fb86c742dee95f6" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 36109 } }
I20251211 15:03:44.738171 17188 leader_election.cc:290] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [CANDIDATE]: Term 1 election: Requested vote from peers 20f83f29bcbb4a84bea17aef6d0ab676 (127.5.160.131:43561), 2a625dab5fb348518201e3b6a2efd434 (127.5.160.129:45169)
I20251211 15:03:44.738656 17117 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9880139c59dc41a6b015f1db0ddf6c5c" candidate_uuid: "acf2f39f448743fc8fb86c742dee95f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f83f29bcbb4a84bea17aef6d0ab676"
I20251211 15:03:44.738792 17117 raft_consensus.cc:3060] T 9880139c59dc41a6b015f1db0ddf6c5c P 20f83f29bcbb4a84bea17aef6d0ab676 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:44.739068 16845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9880139c59dc41a6b015f1db0ddf6c5c" candidate_uuid: "acf2f39f448743fc8fb86c742dee95f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a625dab5fb348518201e3b6a2efd434"
I20251211 15:03:44.739194 16845 raft_consensus.cc:3060] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:03:44.739907 17117 raft_consensus.cc:2468] T 9880139c59dc41a6b015f1db0ddf6c5c P 20f83f29bcbb4a84bea17aef6d0ab676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acf2f39f448743fc8fb86c742dee95f6 in term 1.
I20251211 15:03:44.740283 16916 leader_election.cc:304] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20f83f29bcbb4a84bea17aef6d0ab676, acf2f39f448743fc8fb86c742dee95f6; no voters: 
I20251211 15:03:44.740485 17188 raft_consensus.cc:2804] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:03:44.740701 17188 raft_consensus.cc:697] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [term 1 LEADER]: Becoming Leader. State: Replica: acf2f39f448743fc8fb86c742dee95f6, State: Running, Role: LEADER
I20251211 15:03:44.740849 16845 raft_consensus.cc:2468] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acf2f39f448743fc8fb86c742dee95f6 in term 1.
I20251211 15:03:44.741073 17188 consensus_queue.cc:237] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f83f29bcbb4a84bea17aef6d0ab676" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43561 } } peers { permanent_uuid: "2a625dab5fb348518201e3b6a2efd434" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 45169 } } peers { permanent_uuid: "acf2f39f448743fc8fb86c742dee95f6" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 36109 } }
I20251211 15:03:44.744602 16697 catalog_manager.cc:5654] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to acf2f39f448743fc8fb86c742dee95f6 (127.5.160.130). New cstate: current_term: 1 leader_uuid: "acf2f39f448743fc8fb86c742dee95f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f83f29bcbb4a84bea17aef6d0ab676" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a625dab5fb348518201e3b6a2efd434" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acf2f39f448743fc8fb86c742dee95f6" member_type: VOTER last_known_addr { host: "127.5.160.130" port: 36109 } health_report { overall_health: HEALTHY } } }
I20251211 15:03:44.768182 17179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.764579 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42088 (local address 127.5.160.130:36109)
1211 15:03:44.764776 (+   197us) server_negotiation.cc:207] Beginning negotiation
1211 15:03:44.764780 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:03:44.764796 (+    16us) server_negotiation.cc:408] Connection header received
1211 15:03:44.764885 (+    89us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:03:44.764888 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:03:44.764946 (+    58us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:03:44.765033 (+    87us) server_negotiation.cc:227] Negotiated authn=TOKEN
1211 15:03:44.765418 (+   385us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.766001 (+   583us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:03:44.766787 (+   786us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:03:44.767016 (+   229us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:03:44.767128 (+   112us) server_negotiation.cc:366] Received TOKEN_EXCHANGE NegotiatePB request
1211 15:03:44.767715 (+   587us) server_negotiation.cc:378] Sending TOKEN_EXCHANGE NegotiatePB response
1211 15:03:44.767823 (+   108us) server_negotiation.cc:1036] Waiting for connection context
1211 15:03:44.767963 (+   140us) server_negotiation.cc:300] Negotiation successful
1211 15:03:44.768033 (+    70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20251211 15:03:44.774287 17117 raft_consensus.cc:1275] T 9880139c59dc41a6b015f1db0ddf6c5c P 20f83f29bcbb4a84bea17aef6d0ab676 [term 1 FOLLOWER]: Refusing update from remote peer acf2f39f448743fc8fb86c742dee95f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:03:44.774287 16845 raft_consensus.cc:1275] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434 [term 1 FOLLOWER]: Refusing update from remote peer acf2f39f448743fc8fb86c742dee95f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 15:03:44.775117 17190 consensus_queue.cc:1048] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a625dab5fb348518201e3b6a2efd434" member_type: VOTER last_known_addr { host: "127.5.160.129" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:44.775300 17188 consensus_queue.cc:1048] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20f83f29bcbb4a84bea17aef6d0ab676" member_type: VOTER last_known_addr { host: "127.5.160.131" port: 43561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 15:03:44.785501 17195 mvcc.cc:204] Tried to move back new op lower bound from 7231346379867164672 to 7231346379742994432. Current Snapshot: MvccSnapshot[applied={T|T < 7231346379867164672}]
I20251211 15:03:44.790850 16698 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49480:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:03:44.791065 16698 catalog_manager.cc:2755] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49480:
table { table_name: "test-table" } modify_external_catalogs: true
I20251211 15:03:44.793526 16698 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 5b925f0f71fa4e77b514f7b9775ecb31: Sending DeleteTablet for 3 replicas of tablet 9880139c59dc41a6b015f1db0ddf6c5c
I20251211 15:03:44.794351 16825 tablet_service.cc:1552] Processing DeleteTablet for tablet 9880139c59dc41a6b015f1db0ddf6c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:44 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:40776
I20251211 15:03:44.794389 17097 tablet_service.cc:1552] Processing DeleteTablet for tablet 9880139c59dc41a6b015f1db0ddf6c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:44 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:56098
I20251211 15:03:44.794885 17203 tablet_replica.cc:333] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434: stopping tablet replica
I20251211 15:03:44.794873 16961 tablet_service.cc:1552] Processing DeleteTablet for tablet 9880139c59dc41a6b015f1db0ddf6c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-11 15:03:44 UTC) from {username='kudu', principal='kudu/127.5.160.190@KRBTEST.COM'} at 127.0.0.1:50084
I20251211 15:03:44.795138 17203 raft_consensus.cc:2243] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 15:03:44.795325 17205 tablet_replica.cc:333] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6: stopping tablet replica
I20251211 15:03:44.795542 17203 raft_consensus.cc:2272] T 9880139c59dc41a6b015f1db0ddf6c5c P 2a625dab5fb348518201e3b6a2efd434 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:44.795588 17205 raft_consensus.cc:2243] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [term 1 LEADER]: Raft consensus shutting down.
I20251211 15:03:44.795979 17205 raft_consensus.cc:2272] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 15:03:44.796046  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 16762
I20251211 15:03:44.798039 17205 ts_tablet_manager.cc:1916] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 15:03:44.800711 17205 ts_tablet_manager.cc:1929] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251211 15:03:44.800897 17205 log.cc:1199] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6: Deleting WAL directory at /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1765465326787564-5762-0/minicluster-data/ts-1/wal/wals/9880139c59dc41a6b015f1db0ddf6c5c
I20251211 15:03:44.801316 17205 ts_tablet_manager.cc:1950] T 9880139c59dc41a6b015f1db0ddf6c5c P acf2f39f448743fc8fb86c742dee95f6: Deleting consensus metadata
I20251211 15:03:44.802559 16684 catalog_manager.cc:4985] TS acf2f39f448743fc8fb86c742dee95f6 (127.5.160.130:36109): tablet 9880139c59dc41a6b015f1db0ddf6c5c (table test-table [id=918c3b27ee0f4eb9961edd2e0073cb62]) successfully deleted
W20251211 15:03:44.804983 16685 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.160.129:45169 (error 108)
I20251211 15:03:44.805277  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 16898
I20251211 15:03:44.811127  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 17034
I20251211 15:03:44.812104 17176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:03:44.811554 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.129:45169 (local address 127.0.0.1:37150)
1211 15:03:44.811941 (+   387us) negotiation.cc:107] Waiting for socket to connect
1211 15:03:44.812013 (+    72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.129:45169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":290}
W20251211 15:03:44.812656 16685 catalog_manager.cc:4712] TS 2a625dab5fb348518201e3b6a2efd434 (127.5.160.129:45169): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9880139c59dc41a6b015f1db0ddf6c5c: Network error: Client connection negotiation failed: client connection to 127.5.160.129:45169: connect: Connection refused (error 111)
I20251211 15:03:44.816900  5762 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu with pid 16666
2025-12-11T15:03:44Z chronyd exiting
[       OK ] SecurityITest.TestRequireAuthenticationSecureCluster (3163 ms)
[ RUN      ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Dec 11 15:03:44 dist-test-slave-4k3m krb5kdc[17209](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Dec 11 15:03:44 dist-test-slave-4k3m krb5kdc[17209](info): set up 2 sockets
Dec 11 15:03:44 dist-test-slave-4k3m krb5kdc[17209](info): commencing operation
krb5kdc: starting...
W20251211 15:03:46.651556  5762 mini_kdc.cc:121] Time spent starting KDC: real 1.812s	user 0.005s	sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/test-user.keytab.
Dec 11 15:03:46 dist-test-slave-4k3m krb5kdc[17209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465426, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2025-12-11T15:03:46Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T15:03:46Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.5.160.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.5.160.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.5.160.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/rangeradmin_127.5.160.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.5.160.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/rangeradmin_127.5.160.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.5.160.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.5.160.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.5.160.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/rangerlookup_127.5.160.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.5.160.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/rangerlookup_127.5.160.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.5.160.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/HTTP_127.5.160.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.5.160.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/HTTP_127.5.160.148@KRBTEST.COM.keytab.
I20251211 15:03:46.810686  5762 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.

The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".

Data page checksums are disabled.

creating directory /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default "max_connections" ... 100
selecting default "shared_buffers" ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok

initdb: warning: enabling "trust" authentication for local connections
initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.

Success. You can now start the database server using:

    /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/postgres -l logfile start

2025-12-11 15:03:49.357 UTC [17240] LOG:  starting PostgreSQL 17.2 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0, 64-bit
2025-12-11 15:03:49.357 UTC [17240] LOG:  listening on IPv4 address "127.5.160.148", port 40027
2025-12-11 15:03:49.361 UTC [17240] LOG:  listening on Unix socket "/tmp/.s.PGSQL.40027"
2025-12-11 15:03:49.366 UTC [17245] LOG:  database system was shut down at 2025-12-11 15:03:47 UTC
2025-12-11 15:03:49.371 UTC [17240] LOG:  database system is ready to accept connections
I20251211 15:03:51.131451  5762 mini_postgres.cc:96] Postgres bound to 40027
2025-12-11 15:03:51.137 UTC [17251] FATAL:  database "slave" does not exist
127.5.160.148:40027 - accepting connections
I20251211 15:03:51.137868  5762 mini_ranger.cc:161] Starting Ranger...
I20251211 15:03:51.156196  5762 mini_ranger.cc:84] Created miniranger Postgres user
I20251211 15:03:51.220659  5762 mini_ranger.cc:87] Created ranger Postgres database
I20251211 15:03:51.220752  5762 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-admin
2025-12-11 15:03:51,502  [I] DB FLAVOR :POSTGRES
2025-12-11 15:03:51,502  [I] --------- Verifying Ranger DB connection ---------
2025-12-11 15:03:51,502  [I] Checking connection..
2025-12-11 15:03:51,502  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select 1;"
2025-12-11 15:03:51,812  [I] Checking connection passed.
2025-12-11 15:03:51,812  [I] --------- Verifying version history table ---------
2025-12-11 15:03:51,812  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2025-12-11 15:03:52,121  [I] Table x_db_version_h does not exist in database ranger
2025-12-11 15:03:52,121  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2025-12-11 15:03:52,448  [I] Table x_db_version_h does not exist in database ranger
2025-12-11 15:03:52,449  [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2025-12-11 15:03:52,449  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql 
2025-12-11 15:03:52.747 UTC [17318] WARNING:  there is no transaction in progress
2025-12-11 15:03:52,753  [I] create_dbversion_catalog.sql file imported successfully
2025-12-11 15:03:52,753  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2025-12-11 15:03:53,058  [I] Table x_db_version_h already exists in database 'ranger'
2025-12-11 15:03:53,059  [I] --------- Importing Ranger Core DB Schema ---------
2025-12-11 15:03:53,059  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2025-12-11 15:03:53,365  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2025-12-11 15:03:53,671  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-4k3m.c.gcp-upstream.internal','N') ;"
2025-12-11 15:03:53,974  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2025-12-11 15:03:54,285  [I] Table x_portal_user does not exist in database ranger
2025-12-11 15:03:54,286  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2025-12-11 15:03:54,616  [I] Table x_policy_ref_group does not exist in database ranger
2025-12-11 15:03:54,616  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2025-12-11 15:03:54,929  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2025-12-11 15:03:55,263  [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2025-12-11 15:03:55,264  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql 
2025-12-11 15:03:56.159 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56.173 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56.185 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56.197 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56.209 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56.220 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56.268 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56.273 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56.283 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56.293 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56.303 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56.313 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56.322 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56.327 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56.331 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56.335 UTC [17435] WARNING:  there is no transaction in progress
2025-12-11 15:03:56,785  [I] ranger_core_db_postgres.sql file imported successfully
2025-12-11 15:03:56,786  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2025-12-11 15:03:57,097  [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2025-12-11 15:03:57,098  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2025-12-11 15:03:57,426  [I] Table x_portal_user already exists in database 'ranger'
2025-12-11 15:03:57,427  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2025-12-11 15:03:57,781  [I] Table x_policy_ref_group already exists in database 'ranger'
2025-12-11 15:03:57,782  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2025-12-11 15:03:58,109  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2025-12-11 15:03:58,425  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-4k3m.c.gcp-upstream.internal';"
2025-12-11 15:03:58,721  [I] CORE_DB_SCHEMA import status has been updated
2025-12-11 15:03:58,721  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2025-12-11 15:03:59,056  [I] DB_PATCHES have already been applied
I20251211 15:03:59.062053  5762 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-admin:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskd7u8sQ/thirdparty/src/hadoop-3.4.1/*:/tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20251211 15:03:59.062134  5762 mini_ranger.cc:193] Using host: 127.5.160.148
I20251211 15:03:59.065121  5762 mini_ranger.cc:227] Ranger admin URL: http://127.5.160.148:39495
Dec 11, 2025 3:03:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Dec 11, 2025 3:03:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Dec 11, 2025 3:03:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-admin/ews/webapp
Dec 11, 2025 3:03:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Dec 11, 2025 3:03:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-admin/ews/webapp] .....
Dec 11, 2025 3:03:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-admin/ews/webapp].
Dec 11, 2025 3:03:59 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20251211 15:04:01.070444  5762 mini_ranger.cc:160] Time spent starting Ranger: real 9.933s	user 0.000s	sys 0.009s
Dec 11, 2025 3:04:20 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
  org.apache.ranger.rest
  org.apache.ranger.common
  xa.rest
Dec 11, 2025 3:04:20 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
  class org.apache.ranger.rest.ServiceREST
  class org.apache.ranger.rest.PublicAPIsv2
  class org.apache.ranger.rest.UserREST
  class org.apache.ranger.rest.XUserREST
  class org.apache.ranger.rest.RoleREST
  class org.apache.ranger.rest.TagREST
  class org.apache.ranger.rest.XAuditREST
  class org.apache.ranger.rest.XKeyREST
  class org.apache.ranger.rest.MetricsREST
  class org.apache.ranger.rest.PublicAPIs
  class org.apache.ranger.rest.SecurityZoneREST
  class org.apache.ranger.rest.AssetREST
Dec 11, 2025 3:04:20 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
  class org.apache.ranger.common.RangerJAXBContextResolver
Dec 11, 2025 3:04:20 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Dec 11, 2025 3:04:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Dec 11, 2025 3:04:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Dec 11, 2025 3:04:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Dec 11, 2025 3:04:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Dec 11, 2025 3:04:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Dec 11, 2025 3:04:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Dec 11, 2025 3:04:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Dec 11, 2025 3:04:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Dec 11, 2025 3:04:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Dec 11, 2025 3:04:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Dec 11, 2025 3:04:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Dec 11, 2025 3:04:20 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Dec 11, 2025 3:04:20 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Dec 11, 2025 3:04:21 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
  WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
  WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
  WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20251211 15:04:21.877907  5762 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.5.160.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.5.160.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.5.160.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/rangerkms_127.5.160.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.5.160.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/rangerkms_127.5.160.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.5.160.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.5.160.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/HTTP_127.5.160.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.5.160.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/HTTP_127.5.160.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Dec 11 15:04:21 dist-test-slave-4k3m krb5kdc[17209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465461, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM: 
I20251211 15:04:21.963431  5762 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20251211 15:04:21.972805  5762 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20251211 15:04:22.078609  5762 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20251211 15:04:22.078716  5762 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-kms
I20251211 15:04:22.078759  5762 mini_ranger_kms.cc:227] Using postgres at 127.5.160.148:40027
2025-12-11 15:04:22,255  [I] DB FLAVOR :POSTGRES
2025-12-11 15:04:22,255  [I] --------- Verifying Ranger DB connection ---------
2025-12-11 15:04:22,255  [I] Checking connection
2025-12-11 15:04:22,255  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2025-12-11 15:04:22,595  [I] connection success
2025-12-11 15:04:22,595  [I] --------- Verifying Ranger DB tables ---------
2025-12-11 15:04:22,595  [I] Verifying table ranger_masterkey in database rangerkms
2025-12-11 15:04:22,595  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2025-12-11 15:04:22,918  [I] Table ranger_masterkey does not exist in database rangerkms
2025-12-11 15:04:22,919  [I] --------- Importing Ranger Core DB Schema ---------
2025-12-11 15:04:22,919  [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2025-12-11 15:04:22,919  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.160.148:40027/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2025-12-11 15:04:23,238  [I] kms_core_db_postgres.sql DB schema imported successfully
I20251211 15:04:23.751015  5762 mini_ranger_kms.cc:310] Created kms service
I20251211 15:04:23.974882  5762 mini_ranger_kms.cc:326] Created kudu user
I20251211 15:04:24.028316  5762 mini_ranger_kms.cc:343] Created rangerkms user
Dec 11 15:04:24 dist-test-slave-4k3m krb5kdc[17209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465461, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.5.160.148@KRBTEST.COM
I20251211 15:04:24.461369  5762 mini_ranger_kms.cc:384] Added ranger policy
I20251211 15:04:24.461565  5762 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-kms:/tmp/dist-test-taskd7u8sQ/build/debug/bin/postgresql.jar:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskd7u8sQ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20251211 15:04:24.461587  5762 mini_ranger_kms.cc:240] Using host: 127.5.160.148
I20251211 15:04:24.465344  5762 mini_ranger_kms.cc:276] Ranger KMS PID: 17627
I20251211 15:04:24.465487  5762 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.5.160.148:32835
Dec 11, 2025 3:04:25 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Dec 11, 2025 3:04:25 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Dec 11, 2025 3:04:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Dec 11, 2025 3:04:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-kms/ews/webapp] .....
Dec 11, 2025 3:04:26 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-kms/ews/webapp].
Dec 11, 2025 3:04:26 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20251211 15:04:26.524165  5762 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 4.561s	user 0.007s	sys 0.151s
I20251211 15:04:26.524307  5762 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20251211 15:04:26.524390  5762 mini_ranger_kms.cc:401] 127.5.160.148:32835/kms/v1/keys
Dec 11 15:04:26 dist-test-slave-4k3m krb5kdc[17209](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1765465466, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.160.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Dec 11 15:04:27 dist-test-slave-4k3m krb5kdc[17209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465466, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.160.148@KRBTEST.COM for HTTP/127.5.160.148@KRBTEST.COM
Dec 11 15:04:27 dist-test-slave-4k3m krb5kdc[17209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465466, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.160.148@KRBTEST.COM for HTTP/127.5.160.148@KRBTEST.COM
Dec 11 15:04:30 dist-test-slave-4k3m krb5kdc[17209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465470, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
WARNING: no policy specified for kudu/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:04:30.070261  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:46559
--webserver_interface=127.5.160.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:41407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.160.190:46559
--ranger_config_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.160.148:32835/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:04:30.197217 17680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:04:30.197484 17680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:04:30.197544 17680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:04:30.201082 17680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 15:04:30.201164 17680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:04:30.201186 17680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:04:30.201203 17680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 15:04:30.201220 17680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 15:04:30.206054 17680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:41407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/wal
--ranger_kms_url=127.5.160.148:32835/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.5.160.190:46559
--ranger_config_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.160.190:46559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.160.190
--webserver_port=0
--webserver_require_spnego=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:04:30.207278 17680 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:04:30.208190 17680 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:04:30.214741 17685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:04:30.214823 17680 server_base.cc:1047] running on GCE node
W20251211 15:04:30.214744 17686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:04:30.215092 17688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:04:30.215668 17680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:04:30.216874 17680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:04:30.218055 17680 hybrid_clock.cc:648] HybridClock initialized: now 1765465470218029 us; error 40 us; skew 500 ppm
Dec 11 15:04:30 dist-test-slave-4k3m krb5kdc[17209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465470, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:04:30.221295 17680 init.cc:377] Logged in from keytab as kudu/127.5.160.190@KRBTEST.COM (short username kudu)
I20251211 15:04:30.222656 17680 webserver.cc:492] Webserver started at http://127.5.160.190:46229/ using document root <none> and password file <none>
I20251211 15:04:30.223356 17680 fs_manager.cc:362] Metadata directory not provided
I20251211 15:04:30.223421 17680 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:04:30.223628 17680 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
Dec 11 15:04:30 dist-test-slave-4k3m krb5kdc[17209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465470, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.190@KRBTEST.COM for HTTP/127.5.160.148@KRBTEST.COM
I20251211 15:04:30.278772 17680 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/data/instance:
uuid: "df7be058fe0141168bd6610ca9460482"
format_stamp: "Formatted at 2025-12-11 15:04:30 on dist-test-slave-4k3m"
server_key: "69f7224a5f66b35257ed943781aa58d8"
server_key_iv: "3788abb89cfe26d15097d0c4b6e5ce78"
server_key_version: "kuduclusterkey@0"
I20251211 15:04:30.279467 17680 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/wal/instance:
uuid: "df7be058fe0141168bd6610ca9460482"
format_stamp: "Formatted at 2025-12-11 15:04:30 on dist-test-slave-4k3m"
server_key: "69f7224a5f66b35257ed943781aa58d8"
server_key_iv: "3788abb89cfe26d15097d0c4b6e5ce78"
server_key_version: "kuduclusterkey@0"
I20251211 15:04:30.284245 17680 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20251211 15:04:30.303117 17695 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:04:30.304374 17680 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20251211 15:04:30.304512 17680 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/wal
uuid: "df7be058fe0141168bd6610ca9460482"
format_stamp: "Formatted at 2025-12-11 15:04:30 on dist-test-slave-4k3m"
server_key: "69f7224a5f66b35257ed943781aa58d8"
server_key_iv: "3788abb89cfe26d15097d0c4b6e5ce78"
server_key_version: "kuduclusterkey@0"
I20251211 15:04:30.304629 17680 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:04:30.316928 17680 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:04:30.324460 17680 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:04:30.324692 17680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:04:30.333552 17680 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.190:46559
I20251211 15:04:30.333560 17747 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.190:46559 every 8 connection(s)
I20251211 15:04:30.334728 17680 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/data/info.pb
I20251211 15:04:30.337641 17748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 15:04:30.338435  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 17680
I20251211 15:04:30.338578  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/wal/instance
I20251211 15:04:30.338836  5762 external_mini_cluster.cc:1468] Setting key 43dd0860754c99787dc7be1dab8072f2
I20251211 15:04:30.344059 17748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482: Bootstrap starting.
I20251211 15:04:30.346489 17748 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482: Neither blocks nor log segments found. Creating new log.
I20251211 15:04:30.347332 17748 log.cc:826] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482: Log is configured to *not* fsync() on all Append() calls
Dec 11 15:04:30 dist-test-slave-4k3m krb5kdc[17209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465470, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
I20251211 15:04:30.349697 17748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482: No bootstrap required, opened a new log
I20251211 15:04:30.353183 17748 raft_consensus.cc:359] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7be058fe0141168bd6610ca9460482" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 46559 } }
I20251211 15:04:30.353425 17748 raft_consensus.cc:385] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 15:04:30.353518 17748 raft_consensus.cc:740] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df7be058fe0141168bd6610ca9460482, State: Initialized, Role: FOLLOWER
I20251211 15:04:30.353802 17751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:04:30.340325 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33862 (local address 127.5.160.190:46559)
1211 15:04:30.340813 (+   488us) server_negotiation.cc:207] Beginning negotiation
1211 15:04:30.340826 (+    13us) server_negotiation.cc:400] Waiting for connection header
1211 15:04:30.340868 (+    42us) server_negotiation.cc:408] Connection header received
1211 15:04:30.341515 (+   647us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:04:30.341543 (+    28us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:04:30.341912 (+   369us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:04:30.342267 (+   355us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:04:30.343334 (+  1067us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:04:30.344443 (+  1109us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:04:30.345337 (+   894us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:04:30.345620 (+   283us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:04:30.348645 (+  3025us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:04:30.348667 (+    22us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:04:30.348682 (+    15us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:04:30.348722 (+    40us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:04:30.350801 (+  2079us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:04:30.351364 (+   563us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:04:30.351370 (+     6us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:04:30.351376 (+     6us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:04:30.351465 (+    89us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:04:30.351727 (+   262us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:04:30.351731 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:04:30.351733 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:04:30.352165 (+   432us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:04:30.352397 (+   232us) server_negotiation.cc:1036] Waiting for connection context
1211 15:04:30.352704 (+   307us) server_negotiation.cc:300] Negotiation successful
1211 15:04:30.352957 (+   253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":154,"threads_started":1}
I20251211 15:04:30.354036 17748 consensus_queue.cc:260] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7be058fe0141168bd6610ca9460482" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 46559 } }
I20251211 15:04:30.354199 17748 raft_consensus.cc:399] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 15:04:30.354277 17748 raft_consensus.cc:493] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 15:04:30.354380 17748 raft_consensus.cc:3060] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [term 0 FOLLOWER]: Advancing to term 1
I20251211 15:04:30.355506 17748 raft_consensus.cc:515] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7be058fe0141168bd6610ca9460482" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 46559 } }
I20251211 15:04:30.355895 17748 leader_election.cc:304] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df7be058fe0141168bd6610ca9460482; no voters: 
I20251211 15:04:30.356235 17748 leader_election.cc:290] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20251211 15:04:30.356330 17753 raft_consensus.cc:2804] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 15:04:30.356577 17753 raft_consensus.cc:697] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [term 1 LEADER]: Becoming Leader. State: Replica: df7be058fe0141168bd6610ca9460482, State: Running, Role: LEADER
I20251211 15:04:30.356943 17753 consensus_queue.cc:237] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7be058fe0141168bd6610ca9460482" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 46559 } }
I20251211 15:04:30.357599 17748 sys_catalog.cc:565] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 15:04:30.358587 17754 sys_catalog.cc:455] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df7be058fe0141168bd6610ca9460482. Latest consensus state: current_term: 1 leader_uuid: "df7be058fe0141168bd6610ca9460482" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7be058fe0141168bd6610ca9460482" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 46559 } } }
I20251211 15:04:30.358722 17754 sys_catalog.cc:458] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [sys.catalog]: This master's current role is: LEADER
I20251211 15:04:30.359055 17755 sys_catalog.cc:455] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df7be058fe0141168bd6610ca9460482" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7be058fe0141168bd6610ca9460482" member_type: VOTER last_known_addr { host: "127.5.160.190" port: 46559 } } }
I20251211 15:04:30.359135 17755 sys_catalog.cc:458] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482 [sys.catalog]: This master's current role is: LEADER
I20251211 15:04:30.360133 17762 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 15:04:30.360600 17748 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20251211 15:04:30.365743 17762 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 15:04:30.375977 17762 catalog_manager.cc:1357] Generated new cluster ID: c8a9f0ca71624c09a129f6c792c8569e
I20251211 15:04:30.376081 17762 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 15:04:30.405711 17762 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 15:04:30.407189 17762 catalog_manager.cc:1514] Loading token signing keys...
I20251211 15:04:30.421108 17762 catalog_manager.cc:6027] T 00000000000000000000000000000000 P df7be058fe0141168bd6610ca9460482: Generated new TSK 0
I20251211 15:04:30.422410 17762 catalog_manager.cc:1524] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab.
I20251211 15:04:31.254067  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.160.148:32835/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.129:0
--local_ip_for_outbound_sockets=127.5.160.129
--webserver_interface=127.5.160.129
--webserver_port=0
--tserver_master_addrs=127.5.160.190:46559
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:41407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20251211 15:04:31.386369 17794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:04:31.386615 17794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:04:31.386696 17794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:04:31.390102 17794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:04:31.390182 17794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:04:31.390300 17794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.129
I20251211 15:04:31.394788 17794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:41407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.5.160.148:32835/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.160.129
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:46559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.129
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:04:31.395953 17794 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:04:31.396790 17794 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:04:31.404784 17802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:04:31.405133 17794 server_base.cc:1047] running on GCE node
W20251211 15:04:31.405254 17801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:04:31.405573 17804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:04:31.406042 17794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:04:31.406842 17794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:04:31.408025 17794 hybrid_clock.cc:648] HybridClock initialized: now 1765465471408002 us; error 40 us; skew 500 ppm
Dec 11 15:04:31 dist-test-slave-4k3m krb5kdc[17209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465471, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:04:31.410753 17794 init.cc:377] Logged in from keytab as kudu/127.5.160.129@KRBTEST.COM (short username kudu)
I20251211 15:04:31.411904 17794 webserver.cc:492] Webserver started at http://127.5.160.129:40251/ using document root <none> and password file <none>
I20251211 15:04:31.412447 17794 fs_manager.cc:362] Metadata directory not provided
I20251211 15:04:31.412493 17794 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:04:31.412669 17794 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
Dec 11 15:04:31 dist-test-slave-4k3m krb5kdc[17209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465471, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for HTTP/127.5.160.148@KRBTEST.COM
I20251211 15:04:31.428475 17794 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/data/instance:
uuid: "ecb293bbba604a5b801c748415829b11"
format_stamp: "Formatted at 2025-12-11 15:04:31 on dist-test-slave-4k3m"
server_key: "c1e2b9ce9320680a212ad190c315f1ba"
server_key_iv: "72ff54cf0c0aacf3f725a396a386e4ca"
server_key_version: "kuduclusterkey@0"
I20251211 15:04:31.429147 17794 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance:
uuid: "ecb293bbba604a5b801c748415829b11"
format_stamp: "Formatted at 2025-12-11 15:04:31 on dist-test-slave-4k3m"
server_key: "c1e2b9ce9320680a212ad190c315f1ba"
server_key_iv: "72ff54cf0c0aacf3f725a396a386e4ca"
server_key_version: "kuduclusterkey@0"
I20251211 15:04:31.433991 17794 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20251211 15:04:31.459784 17811 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:04:31.461202 17794 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20251211 15:04:31.461436 17794 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/wal
uuid: "ecb293bbba604a5b801c748415829b11"
format_stamp: "Formatted at 2025-12-11 15:04:31 on dist-test-slave-4k3m"
server_key: "c1e2b9ce9320680a212ad190c315f1ba"
server_key_iv: "72ff54cf0c0aacf3f725a396a386e4ca"
server_key_version: "kuduclusterkey@0"
I20251211 15:04:31.461591 17794 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:04:31.489897 17794 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:04:31.502175 17794 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:04:31.502477 17794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:04:31.503175 17794 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:04:31.504297 17794 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:04:31.504349 17794 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:04:31.504402 17794 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:04:31.504422 17794 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:04:31.516538 17794 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.129:44741
I20251211 15:04:31.517896 17794 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/data/info.pb
I20251211 15:04:31.519205  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 17794
I20251211 15:04:31.519349  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-0/wal/instance
I20251211 15:04:31.519663  5762 external_mini_cluster.cc:1468] Setting key ebc893e4b90a42200b00fbbae93fdb90
I20251211 15:04:31.524279 17924 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.129:44741 every 8 connection(s)
WARNING: no policy specified for kudu/127.5.160.130@KRBTEST.COM; defaulting to no policy
Dec 11 15:04:31 dist-test-slave-4k3m krb5kdc[17209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465471, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.129@KRBTEST.COM for kudu/127.5.160.190@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.160.130@KRBTEST.COM" created.
I20251211 15:04:31.539228 17930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:04:31.527748 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.160.129:57929 (local address 127.5.160.190:46559)
1211 15:04:31.529545 (+  1797us) server_negotiation.cc:207] Beginning negotiation
1211 15:04:31.529549 (+     4us) server_negotiation.cc:400] Waiting for connection header
1211 15:04:31.529561 (+    12us) server_negotiation.cc:408] Connection header received
1211 15:04:31.529596 (+    35us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
1211 15:04:31.529599 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
1211 15:04:31.529644 (+    45us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
1211 15:04:31.529722 (+    78us) server_negotiation.cc:227] Negotiated authn=SASL
1211 15:04:31.531095 (+  1373us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:04:31.531651 (+   556us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
1211 15:04:31.532292 (+   641us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
1211 15:04:31.532474 (+   182us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:04:31.534369 (+  1895us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
1211 15:04:31.534394 (+    25us) server_negotiation.cc:882] Received SASL_INITIATE request from client
1211 15:04:31.534397 (+     3us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
1211 15:04:31.534430 (+    33us) server_negotiation.cc:923] calling sasl_server_start()
1211 15:04:31.536594 (+  2164us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:04:31.537209 (+   615us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:04:31.537213 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:04:31.537215 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:04:31.537351 (+   136us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
1211 15:04:31.537740 (+   389us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
1211 15:04:31.537744 (+     4us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
1211 15:04:31.537746 (+     2us) server_negotiation.cc:968] calling sasl_server_step()
1211 15:04:31.537949 (+   203us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
1211 15:04:31.538026 (+    77us) server_negotiation.cc:1036] Waiting for connection context
1211 15:04:31.538845 (+   819us) server_negotiation.cc:300] Negotiation successful
1211 15:04:31.539038 (+   193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1715,"thread_start_us":84,"threads_started":1}
I20251211 15:04:31.540033 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:04:31.526620 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:46559 (local address 127.5.160.129:57929)
1211 15:04:31.528165 (+  1545us) negotiation.cc:107] Waiting for socket to connect
1211 15:04:31.528213 (+    48us) client_negotiation.cc:174] Beginning negotiation
1211 15:04:31.529162 (+   949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:04:31.529953 (+   791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
1211 15:04:31.529966 (+    13us) client_negotiation.cc:394] Received NEGOTIATE response from server
1211 15:04:31.530299 (+   333us) client_negotiation.cc:189] Negotiated authn=SASL
1211 15:04:31.530881 (+   582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:04:31.530895 (+    14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:04:31.531782 (+   887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
1211 15:04:31.531784 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
1211 15:04:31.532161 (+   377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
1211 15:04:31.532167 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
1211 15:04:31.532390 (+   223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
1211 15:04:31.532997 (+   607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
1211 15:04:31.533023 (+    26us) client_negotiation.cc:656] calling sasl_client_start()
1211 15:04:31.534208 (+  1185us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
1211 15:04:31.536745 (+  2537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:04:31.536751 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:04:31.536766 (+    15us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:04:31.537091 (+   325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:04:31.537474 (+   383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
1211 15:04:31.537478 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
1211 15:04:31.537480 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
1211 15:04:31.537629 (+   149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
1211 15:04:31.538125 (+   496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
1211 15:04:31.538132 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
1211 15:04:31.538481 (+   349us) client_negotiation.cc:769] Sending connection context
1211 15:04:31.538737 (+   256us) client_negotiation.cc:240] Negotiation successful
1211 15:04:31.539061 (+   324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1316,"thread_start_us":115,"threads_started":1}
I20251211 15:04:31.541366 17925 heartbeater.cc:344] Connected to a master server at 127.5.160.190:46559
I20251211 15:04:31.541639 17925 heartbeater.cc:461] Registering TS with master...
I20251211 15:04:31.542275 17925 heartbeater.cc:507] Master 127.5.160.190:46559 requested a full tablet report, sending...
I20251211 15:04:31.544018 17712 ts_manager.cc:194] Registered new tserver with Master: ecb293bbba604a5b801c748415829b11 (127.5.160.129:44741)
I20251211 15:04:31.545481 17712 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.160.129@KRBTEST.COM'} at 127.5.160.129:57929
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal kudu/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab.
WARNING: no policy specified for HTTP/127.5.160.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.160.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Entry for principal HTTP/127.5.160.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab.
Exception in thread "main" I20251211 15:04:31.590153  5762 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
/tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.160.148:32835/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.160.130:0
--local_ip_for_outbound_sockets=127.5.160.130
--webserver_interface=127.5.160.130
--webserver_port=0
--tserver_master_addrs=127.5.160.190:46559
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--webserver_require_spnego=true
--builtin_ntp_servers=127.5.160.148:41407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
org.apache.kudu.subprocess.KuduSubprocessException: Failed to login with Kudu principal/keytab
	at org.apache.kudu.subprocess.ranger.authorization.RangerKuduAuthorizer.init(RangerKuduAuthorizer.java:87)
	at org.apache.kudu.subprocess.ranger.RangerProtocolHandler.<init>(RangerProtocolHandler.java:45)
	at org.apache.kudu.subprocess.ranger.RangerSubprocessMain.main(RangerSubprocessMain.java:39)
Caused by: org.apache.hadoop.security.KerberosAuthException: failure to login: for principal: kudu/127.5.160.190 from keytab /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab javax.security.auth.login.LoginException: Unable to obtain password from user

	at org.apache.hadoop.security.UserGroupInformation.doSubjectLogin(UserGroupInformation.java:2064)
	at org.apache.hadoop.security.UserGroupInformation.loginUserFromKeytabAndReturnUGI(UserGroupInformation.java:1398)
	at org.apache.hadoop.security.UserGroupInformation.loginUserFromKeytab(UserGroupInformation.java:1136)
	at org.apache.kudu.subprocess.ranger.authorization.RangerKuduAuthorizer.init(RangerKuduAuthorizer.java:85)
	... 2 more
Caused by: javax.security.auth.login.LoginException: Unable to obtain password from user

	at com.sun.security.auth.module.Krb5LoginModule.promptForPass(Krb5LoginModule.java:901)
	at com.sun.security.auth.module.Krb5LoginModule.attemptAuthentication(Krb5LoginModule.java:764)
	at com.sun.security.auth.module.Krb5LoginModule.login(Krb5LoginModule.java:618)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at javax.security.auth.login.LoginContext.invoke(LoginContext.java:755)
	at javax.security.auth.login.LoginContext.access$000(LoginContext.java:195)
	at javax.security.auth.login.LoginContext$4.run(LoginContext.java:682)
	at javax.security.auth.login.LoginContext$4.run(LoginContext.java:680)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.login.LoginContext.invokePriv(LoginContext.java:680)
	at javax.security.auth.login.LoginContext.login(LoginContext.java:587)
	at org.apache.hadoop.security.UserGroupInformation$HadoopLoginContext.login(UserGroupInformation.java:2148)
	at org.apache.hadoop.security.UserGroupInformation.doSubjectLogin(UserGroupInformation.java:2053)
	... 5 more
I20251211 15:04:31.608359 17786 server.cc:273] Received an EOF from the subprocess
F20251211 15:04:31.609552 17774 server.cc:406] The subprocess has exited with status 1
*** Check failure stack trace: ***
    @     0x7f35577aedcd  google::LogMessage::Fail() at ??:0
    @     0x7f35577b2b93  google::LogMessage::SendToLog() at ??:0
    @     0x7f35577ae7cc  google::LogMessage::Flush() at ??:0
    @     0x7f35577aff59  google::LogMessageFatal::~LogMessageFatal() at ??:0
    @     0x7f35594652d7  kudu::subprocess::SubprocessServer::ExitCheckerThread() at ??:0
    @     0x7f35594620d9  _ZZN4kudu10subprocess16SubprocessServer4InitEvENKUlvE0_clEv at ??:0
    @     0x7f3559466005  _ZNSt17_Function_handlerIFvvEZN4kudu10subprocess16SubprocessServer4InitEvEUlvE0_E9_M_invokeERKSt9_Any_data at ??:0
    @     0x55a61c0f1a0a  std::function<>::operator()() at ??:0
    @     0x7f3558c087dc  kudu::Thread::SuperviseThread() at ??:0
    @     0x7f35594a16db  start_thread at ??:0
    @     0x7f355696571f  clone at ??:0
W20251211 15:04:31.729918 17935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 15:04:31.730152 17935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 15:04:31.730216 17935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 15:04:31.733750 17935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20251211 15:04:31.733829 17935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 15:04:31.733911 17935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.160.130
I20251211 15:04:31.738574 17935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.160.148:41407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.5.160.148:32835/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/krb5kdc/kudu.keytab
--principal=kudu/127.5.160.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.160.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.160.130
--webserver_port=0
--webserver_require_spnego=true
--tserver_master_addrs=127.5.160.190:46559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.160.130
--log_dir=/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 11 Dec 2025 14:43:15 UTC on 24a791456cd2
build id 9462
I20251211 15:04:31.739770 17935 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 15:04:31.740640 17935 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 15:04:31.747550 17952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:04:31.747546 17955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 15:04:31.747640 17953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 15:04:31.747771 17935 server_base.cc:1047] running on GCE node
I20251211 15:04:31.748313 17935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 15:04:31.748903 17935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 15:04:31.750056 17935 hybrid_clock.cc:648] HybridClock initialized: now 1765465471750032 us; error 44 us; skew 500 ppm
Dec 11 15:04:31 dist-test-slave-4k3m krb5kdc[17209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465471, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20251211 15:04:31.752884 17935 init.cc:377] Logged in from keytab as kudu/127.5.160.130@KRBTEST.COM (short username kudu)
I20251211 15:04:31.754011 17935 webserver.cc:492] Webserver started at http://127.5.160.130:43451/ using document root <none> and password file <none>
I20251211 15:04:31.754563 17935 fs_manager.cc:362] Metadata directory not provided
I20251211 15:04:31.754613 17935 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 15:04:31.754798 17935 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
Dec 11 15:04:31 dist-test-slave-4k3m krb5kdc[17209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1765465471, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.160.130@KRBTEST.COM for HTTP/127.5.160.148@KRBTEST.COM
I20251211 15:04:31.769366 17935 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/data/instance:
uuid: "e6060fbf300342c49bcf2de23b9f1688"
format_stamp: "Formatted at 2025-12-11 15:04:31 on dist-test-slave-4k3m"
server_key: "3437b265ac63bbd40a40b7e9e42a50bf"
server_key_iv: "a364047497cf4f0b42e6ce52155179f7"
server_key_version: "kuduclusterkey@0"
I20251211 15:04:31.770304 17935 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance:
uuid: "e6060fbf300342c49bcf2de23b9f1688"
format_stamp: "Formatted at 2025-12-11 15:04:31 on dist-test-slave-4k3m"
server_key: "3437b265ac63bbd40a40b7e9e42a50bf"
server_key_iv: "a364047497cf4f0b42e6ce52155179f7"
server_key_version: "kuduclusterkey@0"
I20251211 15:04:31.775130 17935 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20251211 15:04:31.787756 17962 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:04:31.789073 17935 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20251211 15:04:31.789194 17935 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/data,/tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/wal
uuid: "e6060fbf300342c49bcf2de23b9f1688"
format_stamp: "Formatted at 2025-12-11 15:04:31 on dist-test-slave-4k3m"
server_key: "3437b265ac63bbd40a40b7e9e42a50bf"
server_key_iv: "a364047497cf4f0b42e6ce52155179f7"
server_key_version: "kuduclusterkey@0"
I20251211 15:04:31.789314 17935 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 15:04:31.805956 17935 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20251211 15:04:31.808902 17935 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 15:04:31.809080 17935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 15:04:31.809667 17935 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 15:04:31.810576 17935 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 15:04:31.810633 17935 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:04:31.810674 17935 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 15:04:31.810703 17935 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20251211 15:04:31.820245 17935 rpc_server.cc:307] RPC server started. Bound to: 127.5.160.130:34105
I20251211 15:04:31.820529 18075 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.160.130:34105 every 8 connection(s)
I20251211 15:04:31.821240 17935 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/data/info.pb
I20251211 15:04:31.828622  5762 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskd7u8sQ/build/debug/bin/kudu as pid 17935
I20251211 15:04:31.828747  5762 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskd7u8sQ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1765465326787564-5762-0/minicluster-data/ts-1/wal/instance
I20251211 15:04:31.828971  5762 external_mini_cluster.cc:1468] Setting key 1e1d984f864991fe206a9dc3ce007a95
W20251211 15:04:31.847770 17207 connection.cc:537] client connection to 127.5.160.190:46559 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251211 15:04:31.848589 18078 negotiation.cc:337] Failed RPC negotiation. Trace:
1211 15:04:31.823349 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:46559 (local address 127.5.160.130:52137)
1211 15:04:31.823852 (+   503us) negotiation.cc:107] Waiting for socket to connect
1211 15:04:31.823900 (+    48us) client_negotiation.cc:174] Beginning negotiation
1211 15:04:31.824834 (+   934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1211 15:04:31.847887 (+ 23053us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:46559: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":101,"threads_started":1}
W20251211 15:04:31.849074 18076 heartbeater.cc:646] Failed to heartbeat to 127.5.160.190:46559 (0 consecutive failures): Network error: Failed to ping master at 127.5.160.190:46559: Client connection negotiation failed: client connection to 127.5.160.190:46559: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251211 15:04:31.849820 18078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:04:31.849556 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:46559 (local address 127.5.160.130:33975)
1211 15:04:31.849696 (+   140us) negotiation.cc:107] Waiting for socket to connect
1211 15:04:31.849755 (+    59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:46559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20251211 15:04:31.850531 18078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:04:31.850341 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:46559 (local address 127.5.160.130:43849)
1211 15:04:31.850436 (+    95us) negotiation.cc:107] Waiting for socket to connect
1211 15:04:31.850478 (+    42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:46559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20251211 15:04:31.850741 18076 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20251211 15:04:32.548682 17925 heartbeater.cc:499] Master 127.5.160.190:46559 was elected leader, sending a full tablet report...
I20251211 15:04:32.549593 18080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:04:32.549148 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:46559 (local address 127.5.160.129:50703)
1211 15:04:32.549408 (+   260us) negotiation.cc:107] Waiting for socket to connect
1211 15:04:32.549477 (+    69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:46559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":76,"threads_started":1}
W20251211 15:04:32.549854 17925 heartbeater.cc:646] Failed to heartbeat to 127.5.160.190:46559 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.5.160.190:46559: connect: Connection refused (error 111)
I20251211 15:04:32.852093 18081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:04:32.851578 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:46559 (local address 127.5.160.130:57461)
1211 15:04:32.851905 (+   327us) negotiation.cc:107] Waiting for socket to connect
1211 15:04:32.851973 (+    68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:46559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":103,"threads_started":1}
I20251211 15:04:33.551054 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:04:33.550498 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:46559 (local address 127.5.160.129:55425)
1211 15:04:33.550818 (+   320us) negotiation.cc:107] Waiting for socket to connect
1211 15:04:33.550884 (+    66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:46559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":80,"threads_started":1}
I20251211 15:04:33.853431 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:04:33.852922 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:46559 (local address 127.5.160.130:53953)
1211 15:04:33.853241 (+   319us) negotiation.cc:107] Waiting for socket to connect
1211 15:04:33.853315 (+    74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:46559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":102,"threads_started":1}
I20251211 15:04:34.552327 18084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:04:34.551904 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:46559 (local address 127.5.160.129:39545)
1211 15:04:34.552164 (+   260us) negotiation.cc:107] Waiting for socket to connect
1211 15:04:34.552226 (+    62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:46559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":78,"threads_started":1}
I20251211 15:04:34.854789 18085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:04:34.854277 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:46559 (local address 127.5.160.130:50907)
1211 15:04:34.854619 (+   342us) negotiation.cc:107] Waiting for socket to connect
1211 15:04:34.854688 (+    69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:46559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":84,"threads_started":1}
I20251211 15:04:35.553678 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:04:35.553162 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:46559 (local address 127.5.160.129:49523)
1211 15:04:35.553513 (+   351us) negotiation.cc:107] Waiting for socket to connect
1211 15:04:35.553575 (+    62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:46559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":102,"threads_started":1}
I20251211 15:04:35.856144 18087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:04:35.855652 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:46559 (local address 127.5.160.130:56175)
1211 15:04:35.855976 (+   324us) negotiation.cc:107] Waiting for socket to connect
1211 15:04:35.856041 (+    65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:46559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":78,"threads_started":1}
I20251211 15:04:36.555096 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:04:36.554567 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:46559 (local address 127.5.160.129:41327)
1211 15:04:36.554885 (+   318us) negotiation.cc:107] Waiting for socket to connect
1211 15:04:36.554991 (+   106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:46559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":79,"threads_started":1}
I20251211 15:04:36.857641 18089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
1211 15:04:36.857120 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.160.190:46559 (local address 127.5.160.130:49525)
1211 15:04:36.857464 (+   344us) negotiation.cc:107] Waiting for socket to connect
1211 15:04:36.857534 (+    70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.160.190:46559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":82,"threads_started":1}
F20251211 15:04:36.888695  5762 external_mini_cluster.cc:650] Check failed: leader_master() != nullptr Must have started at least 1 master before adding tablet servers
*** Check failure stack trace: ***
*** Aborted at 1765465476 (unix time) try "date -d @1765465476" if you are using GNU date ***
PC: @                0x0 (unknown)
*** SIGABRT (@0x3e800001682) received by PID 5762 (TID 0x7fc5c30a4d80) from PID 5762; stack trace: ***
    @     0x7fc5ced40980 (unknown) at ??:0
    @     0x7fc5cc377fb7 gsignal at ??:0
    @     0x7fc5cc379921 abort at ??:0
    @     0x7fc5cd5e5dcd google::LogMessage::Fail() at ??:0
    @     0x7fc5cd5e9b93 google::LogMessage::SendToLog() at ??:0
    @     0x7fc5cd5e57cc google::LogMessage::Flush() at ??:0
    @     0x7fc5cd5e6f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
    @     0x7fc5d0371cab kudu::cluster::ExternalMiniCluster::AddTabletServer() at ??:0
    @     0x7fc5d036e9c6 kudu::cluster::ExternalMiniCluster::Start() at ??:0
    @     0x55b52aa4d92f kudu::SecurityITest::StartCluster() at ??:0
    @     0x55b52aa35792 kudu::SecurityITest_TestEncryptionWithKMSIntegration_Test::TestBody() at ??:0
    @     0x7fc5ce5f50ed testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
    @     0x7fc5ce5e9bdb testing::Test::Run() at ??:0
    @     0x7fc5ce5e9d9d testing::TestInfo::Run() at ??:0
    @     0x7fc5ce5ea377 testing::TestSuite::Run() at ??:0
    @     0x7fc5ce5ea77c testing::internal::UnitTestImpl::RunAllTests() at ??:0
    @     0x7fc5ce5f560d testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
    @     0x7fc5ce5e9e63 testing::UnitTest::Run() at ??:0
    @     0x55b52aa85c7e RUN_ALL_TESTS() at ??:0
    @     0x55b52aa84e6b main at ??:0
    @     0x7fc5cc35abf7 __libc_start_main at ??:0
    @     0x55b52aa1d06a _start at ??:0
2025-12-11 15:04:37.065 UTC [17658] FATAL:  terminating connection due to unexpected postmaster exit
2025-12-11 15:04:37.065 UTC [17555] FATAL:  terminating connection due to unexpected postmaster exit
2025-12-11 15:04:37.066 UTC [17552] FATAL:  terminating connection due to unexpected postmaster exit
2025-12-11 15:04:37.066 UTC [17550] FATAL:  terminating connection due to unexpected postmaster exit
2025-12-11 15:04:37.067 UTC [17551] FATAL:  terminating connection due to unexpected postmaster exit
2025-12-11 15:04:37.067 UTC [17554] FATAL:  terminating connection due to unexpected postmaster exit